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ON  THE  USE  OF  FRAMED  KNOWLEDOE  IN  I.ANOUACE  COMPREHENSION 


Eugene  Charnlak 
Yale  University 
Department  of  Computer  Science 

Running  title:  ON  THE  USE  OF  FRAMED  KNOWLEDGE 

ABSTRACT 

Notions  like  "frames",  "scripts"  etc-  are  now  being  used  -tn  programs  to 
understand  connected  discourse-  V/e  wll'  d£sc»-lbr  a program  In  this  vein  which 
understands  simple  stories  about  painting-  (Jack  was  painting  a chair-  He 
dipped  a brush  Into  some  paint-  Q:  Why?)  In  partcular,  problems  of  matching, 
read  time  Inference,  and  undoing  false  conclusions  will  be  stressed.  The 
program  makes  heavy  use  of  real  world  knowledge,  and  there  Is  an  extensive 
discussion  of  various  Issues  in  knowledge  reprt sentatlon  and  how  they  affect 
frame  representations:  modularity,  the  need  for  problem  so’vlng,  worldly  vs 

control  knowledge,  and  cleanlyness-  The  paper  concludes  with  an  extensive 
discussion  of  the  program's  shortcommlngs - 


1.  INTRODUCTION 

Much  recfnt  work  In  artificial  Intelligence  sees  l.'nguage  comprehension  es 
a process  of  relating  language  derived  infoimatlon  to  previously  stored  ehunks 
of  stereotyped  knowlidgc.  variously  cnlled  "frames"  (Minsky  [1]).  "scripts" 
(Si  hank  and  Abel  son  f?]),  "units"  (Bobrow  and  Wlnogrnd  [3]),  "depictions"  (Hayes 
(4)),  "common  sense  algorithms"  (Rieger  (5)).  etc-  This  paper  will  describe  e 
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computer  progrsn,  Ms-  Kalaprop,  which  is  so’id’y  within  this  "tradition"  in 
that  It  uses  a "framed"  knowledge  of  mundane  painting  to  answer  questions  about 
simple  texts  such  as:  "Jack  was  painting  a chair.  He  dipped  a brush  into  some 
paint-  Q:  Why?" 


The  paper  will  try  to  operate  on  tv/o  levels-  On  one  hand  1 want  to  give  a 
clear  explanation  of  how  Ms.  Malaprop  works-  On  the  other  I will  emphasize 
certain  ideas  about  knowledge  representation-  With  regard  to  the  former  we  hav'c 
the  following  major  points: 

Frame  comprehension  hypothesi  s - Most  systems  vthich  use  framr  s to 
understand  assume  what  I shall  call  the  "fr;mc  comprehension  hypothesis"-  This 
has  it  that  a major  part  of  understanding  is  the  matching  of  incoming  story 
Information  against  the  framed  knowledge  of  what  normally  occurs-  So,  for 
example : 


Jack  was  going  to  paint  a chair-  He  washed  It- 

0:  Why?  A:  One  should  clean  things  one  is  going  to  paint - 

(Let  me  note  here  that  this,  as  well  as  all  other  "painting"  examples  are 

handled  by  the  current  version  of  Ms-  Malaprop-  However,  the  input  is  not 

English,  but  rather  a "semantic  representation"  to  be  described  later-)  Ms - 
Malaprop  understands  this  example  because  she  has  stored  the  fact  that  one 
typically  cleans  objects  before  painting  them,  and  the  second  sentence  will 
match  this  portion  of  the  description  of  the  painting  act- 

Matciiing-  The  purpose  of  matching  ir  to  Identify  the  prototypical  event 
eluded  lo  by  an  occurance  in  tlie  story.  In  general  this  matching  can  he  quite 

complex,  and  involves  issues  of  time,  how  close  the  story  event  is  to  the 
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prototypical  event  in  terms  of  objects  used,  rtc. 


So , for  (xampl c : 


PCRl  '■ 


Jack  was  going  to  paint  a cba1r.  He  dipped  a brush  into  the  paint. 
Q:  Why?  A:  To  get  paint  on  It. 


' In  order  to  make  the  match  here  Ms.  Malaprop  must  identify  "r  brush"  with  the 

j Instrument  of  painting.  Because  brusiies  are  normally  used  this  way  the 

j identification  is  made  and  the  match  Js  successful  - If  we  bad  said  "He  dipped  r 

[ finger  into  the  paint"  this  would  not  have-  been  the  case. 

i 

I Read  time  inference.  Ms-  Malaprop  makes  many  inferences  vthllr  reading. 

It  is  necessary  to  control  such  Inferences  tightly,  since  In  principle  there  is 
no  limit  on  how  many  could  be  made-  After  we  distinguish  between  abductlve  icir 
"explainltory")  and  deductive  Inferences,  of  which  Ms-  Malaprop  only  does  thr- 
latter,  the  program  recognizes  the  need  for  three  kinds  of  deductlvf  Inferences 
a)  when  a contradiction  is  noticed,  b)  when  a frame  expectation  Is  confounded, 

I and  c)  when  the  input  imples  a state  or  event  which  is  important  for  the 

j activities  discussed  In  the  story. 

Undoing  wrong  cone  1 us  ions  . A system  which  males  Inferences  while  reading 

( 

j will  invariably  moke  some  false  ones.  Should  Ms-  Malaprop  later  discover  that 

j a particular  conclusion  Is  wrong  she  will  correct  it,  as  well  as  anything  which 

1 • 

might  havp  been  derived  from  it-  So,  for  exrmplc: 

\ 

Jack  finished  painting.  He  did  not  clean  the  brush. 

I Q:  What  happened?  A:  The  brush  b' came  unabsorbent. 

He  left  the  brush  in  the  paint- 

Q:  Did  the  brush  become  unabsorbent?  A:  No 

' Q:  Wl(y  not?  A-  Cec;  use  the  paint  does  not  dry  on  the  brush. 
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Note  that  In 

this 

example  tlu  sc'C 

ond  line  matches 

the 

negation  of  our 

frame 

expec  ta  tion 

tha  t 

the  instrument 

will  be  cleaned. 

Ma 

tehing  a statement 

against 

i ts  negation 

is  non  standard  from 

r.  logical  point 

of 

view,  but  seems 

to  be 

Important  tr  Ir.ngiiagr  comprf  lions  ion  (of.  Vi  IPs  [6]). 

As  mrntlonorl  abovo,  tlio  worUrgs  of  . Malaprop  is  only  onr  of  my 
conoorns  boro.  Ms.  Malaprop  was  initially  deslgnod  to  oxcrcjsc  a knov'lcdgo 
representation  scheme  which  1 h.ad  previously  developed  [7].  As  such,  while  the 
workings  of  the  program  are  of  interest  in  their  own  right.  I tend  to  view  the 
program  as  illustrating  certain  problems  and  theories  in  the  domain  of  knowledge 
representation.  Hence,  while  describing  the  program  I will  be  making  constant 
reference  to  a set  of  issues  which  have  been  of  concern  to  me  in  the  development 
of  the  knowledge  representation  used  here.  In  particular' 

Modularity.  To  avoid  repeating  the  same  knowledge  in  several  different 
"frames"  it  is  necessary  to  modularize  the  knowledge  used.  So.  for  cxamplt . the 
notion  of  "evaporation"  comes  up  often  in  the  painting  domain,  as  well  rs  in 
many  other  domains.  If  each  time  we  needed  some  knowledge  about  evaporation  (as 
in  "why  should  one  wash  the  brush  afterwards",  or  "why  close  the  paint  can  whtn 
done")  we  would  find  ourselves  stating  the  same  facts  many  times  over  in  our 
representation.  It  would  clearly  be  better  (ceterus  approximately  paribus)  to 
state  this  knowledge  once,  and  have  other  frames  use  it  when  needed.  Yet  the 
traditional  "frame"  notion  of  comprehension  has  It  that  we  bring  in  one  "chunk" 
of  knowledge  in  order  to  understand  e certain  stereotyped  situation.  We  must. 
In  other  words,  harmonize  this  idee  with  the  opposite  one  of  modularl.y. 

-VJEjl  1 nowl edge . It  is  generally  recognized  that  facts 
without  knowledge  of  hov  to  use  them  lead  to  comblnctorial  desth.  This  inspired 
the  PLANNER-1  ike  languages  (like  that  of  Hewitt  18]).  where  knowledge  end 
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iiso-knowl  rdpc  wore  bound  together  in  the  form  of  progrrtns-  The  troubJ*'  v.'i  th 
this  approach  Is  that  It  does  not  nllev;  for  the  most  general  use  of  the 
knowledge,  and  also  makes  additivity  difficult.  Hence  Ms.  Malaprop  separates 
facts  about  the  world  from  knowledge  about  how  the  facts  are  to  be  used-  Tills 
separation  Is  not  as  complete  as  that  demanded  by  Kowalski  [9]  hovtever. 

Cleanl Iness . My  goal  in  designing  Ms.  Malaprop  was  to  make  the  knowledge 
representalon  as  clean  as  possible.  This  can  be  defended  on  "philosophical" 
grounds  In  that  good  theories  are  clean  theories.  However,  at  a more  pragmatic 
level  the  dirtier  the  representation  the  harder  It  w1  1 ’ be  to  write  programs 
which  use  It.  So  the  frames  are  precisely  deflnt’d  as  having  certain  compontnts, 
each  of  which  have  r.  certain  significance,  etc.  One  particular  effort  at 
cleanl3mess  Is  an  almost  complete  ban  on  "procedural  embedding"  [3]. 

Problem  solving . Probably  the  major  objection  to  "frames"  has  been  from 
those  who  see  human  behavior  as  too  diverse  to  make  stereotyped  knowledge  of 
much  use.  While  I doubt  that  there  Is  really  any  alternative  to  the  sort  of 
frames  presented  here,  I am  sufficiently  impressed  by  this  objection  to  want  my 
frames  to  be  compatible  with  the  problem  solving  procedures  which  must  surely 
accompany  them. 

Section  2 prcst'nls  a review  of  the  lepresentat  Ion  - The  factual  material  ■'n 
this  section  will  be  familiar  to  those  who  have  read  "Framed  PAINTING"  [7] 
although  the  justification  of  the  representation  In  terms  of  the  above  goals  Is 
new.  Section  3 outlln<'s  the  probram,  while  U and  5 describe  matching  and  read 
time  Inference  Ir  more  detail.  Section  6 Is  an  extended  example.  Finally. 
Section  7 describes  limitations  of  both  the  program  and  the  representation. 
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2.  THE  FRAMED  PAINTING  REPRESENTATION 


2.1  The  Basic  Representation. 


As  may  have  become  apparent  from  the  examples  I have  used,  I am  primarily 
concerned  with  "how  to  do  it"  knowledge.  1 am  not  Interested  in  Including  in  my 
representation  of  mundane  painting  the  fact  that  "the  fastest  time  for  painting 
a 10  by  20  ft.  wall  was  ..."  With  this  in  mind  it  is  natural  to  see  the  frame 
as  a series  of  instructions  of  the  form,  "first  do  this,  then  do..."  So  we  might 


(PAINTING  (COMPLEX-EVENT) 


GOAL;  PAINTING-GOAL 

(PAINT  coats  OBJECT) 

EVENT:  PAINTINGI  (OBJECT  is  clean) 
PAINTING 2 

(PAPER  around  OBJEGT) 
PAINTING 3 
(LOOP 
PAINTING/. 

(PAINT  on  INSTRUMENT) 
PAINTINGS 

(INSTRUMENT  In  eon tart 

with  OBJECT)  ) 

PAINTINC8 

(PAINT  no  longer  on 

INSTRUMENT)  ) 


;Anythlng  following  a ";"  ts  a 
; comment 

;Norma]ly  painting  is  done  to 
;accomplish  this  goal. 

;The  EVENT  section  describes  bow 
;to  paint  in  more  detail. 


;Tliings  like  PAINTING3  are  the 
;namcs  of  the  individual  state- 
;ment6  (here  expressed  in  semi 

;Engl ish) . 

;The  arrows,  of  course,  indi- 
;cate  time  ordering. 


The  English-like  statements  will  eventually  be  replaced  by  formalism,  but  we  can 
already  sec  one  tendency  which  will  eontinue  throughout  the  paper.  All  of  the 
statements  express  states  to  be  achieved,  rather  than  actions  to  be  performed. 
This  Is  a reflection  of  the  fact  that  1 want  these  frames  to  be  compatible  with 
prebleiii  solving  procedures,  and  In  most  goal  oriented  activltcs  we  are 
Interested  In  some  c-nd  state  rather  than  the  I'xact  way  it  is  achieved.  Fo . for 
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example,  if  the  OBJECT  is  already  clean,  then  it  is  not  necessary  to  clem  it 
again*  Hence  the  command  is  "achieve  (OBJECT  is  clean)"  rather  than  "(clean  the 
OBJECT)".  However,  since  every  state  in  the  frame  is  to  be  achieved,  the 
"achieve",  is  left  implicit,  and  only  the  desired  state  is  Indicated* 

The  frame  as  given  is  usable  for  both  rollers  and  brushes  and  hence  the 
neutral  term  INSTPUl'ENT  has  been  used*  (Note  however  that  It  is  not  good  for 
spray  guns,  a problem  which  will  not  b(  considered  here*)  Clearly  In  one  story 
INSTRUMENT  will  be  one  kind  of  object,  while  in  a second  it  will  be  something 
else*  That  Is  to  say  that  TNSTRltMENT  (and  PAINT,  and  AGENT  etc*)  must  bo  a 
variable*  On  the  other  hand  there  are  restrictions  on  what  sorts  of  things  can 
be  bound  to  these  variables*  This  information  will  be  included  as  follows: 


(PAINTING  (COMPLEX-EVENT) 

VARS:  (AGENT  (ANIMATE  AGENT)) 
(OBJECT  (SOLID  OBJECT)) 
(PAINT  (LIQUID  PAINT) 
NORMAL:  (PAINT  PAINT)) 
(INSTRUMENT 
(SOLID  INSTRUMENT) 

NORMAL: 

PAINTING-BRUSH 
(PAINT-BRUSH  INSTRUMENT) 
PAINTING-ROLLER 

(ROLLER  INSTRUMENT) 
(ABSORBANT  INSTRUMENT) 


;The  agent  must  be  animate,  the 
•jObject,  solid,  the  paint  liquid* 

;Hormally  the  liquid  used  in 
;painting  is  paint* 

;Normal ly  the  instrument  is  either 
;a  paint  brush  or  a roller,  and 
;absorbent*  Note  that  two  of  the 
;statements  are  named  (e.g*, 

; PAINTING-BRUSH ) . A statement  is 
) ;givcn  a name  if  one  needs  to  refer 
;to  it  elsewhere. 


(Throughout  the  paper  we  will  add  pieces  to  PAINTING*  A version  which  Includes 
everything  mentioned  in  the  paper  is  found  in  the  appendix.)  Intuitively  the 
distinction  between  the  absolute  reslrlcions  (those  which  are  given  first)  and 
the  normal  restrictions  is  that  the  fotmer  mtist  be  true  of  anything  bound  to  the 
variable,  while  the  latter  ere  more  like  defaults*  The  distinction  in  terms  of 
procosm's  will  be  given  in  the  section  on  matching  (3). 
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Note  that  I have  replaced  the  Informa’  English  with  a typical  "semantic 
representation"  consisting  of  a predicate  (e.g  , PAINT-BRUSH)  plus  arguments 
(e.g.,  INSTRUMENT).  We  shall  see  later  that  PAINT-BRUSH,  and  Indeed  all 
predicates,  are  themselves  frames,  but  this  need  not  concern  us  here. 

2.2  The  COMES -FROM  Link 

PAINTING  ns  given  above  explicates  the  action  In  so  for  as  It  breaks  It 
down  Into  simpler  problems.  However  It  does  not  go  nearly  far  enough  In  this 
direction.  For  example,  while  It  says  to  get  paint  on  the  Instrument,  it  does 
not  Indicate  how  this  should  be  done.  Yet  you  and  I know  that  immersing  the 
instrument  In  the  paint  Is  typical,  while  pouring  the  paint  over  the  instrvimcnt 
is  not.  Or  again,  the  object  to  be  painted  Is  cleaned  by  washing,  not  by,  say, 
dry  cleaning.  We  will  Indicate  such  Information  with  "COMES-FROM  links"  on  the 
affected  statements,  as  In: 

PAINTINGl  lOBJECT  Is  clean) 

COMES-FROM:  ((WASH-COAL)) 

In  effect  we  are  saying  here  that  the  goal  (OBJECT  Is  clean)  comes  about  by  (or 
COMES-FROM)  using  the  WASH  frame  to  establish  Its  normal  goal.  That  is,  we  v»lll 
have  in  WASH: 

(WASH  (COMPLEX-EVENT) 

VARS:  ... 

COAL:  WASH-COAL  (WASH-OBJECT  Is  clean) 

. . . ) 


WASH-COAL  Iw're  Is  simply  the  name  of  th.e  statement  (WASH-OBJECT  Is  clean)  and  as 
surh  Is  simply  an  arbitrary  symbol. 
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I nilp;ht  notr  that  having  one  frame  know  the  names  of  statements  In  another 
will  appear  to  many  (myself  Included)  as  a blow  to  additivity.  In  section  7 I 
will  discuss  the  possibility  of  doing  away  with  this  "feature". 

To  take  the  other  example,  after  finishing  the  main  loop,  but  before 
cleaning  the  instrument,  we  want  to  keep  the  paint  on  the  Instrument  away  from 
the  air.  This  is  done  by  leaving  the  instrument  In  the  paint. 

PAINTING?  (NOT  (ATMOSPHERE-CONTACT  SOME-PAINT)) 

COMES-FROMr  ( (LIQUID-IN4) ) 

Note  that  SOME-PAINT  here  Is  just  another  variable,  and  Is  defined  as  being  part 
of  PAINT.  In  particular  the  program  has  no  theory  of  quantification  which  would 
allow  It  to  handle  "some"  In  a general  way. 


(LIOUID-IN  (STATE) 

VARS:  ... 

RELATIONS:  ... 

(LIQUID-IN 3 (LIQUID-IN  OBJECT  LIQUID)  ;If  an  object  Is  In  a liquid 

IMPLIES  ;then  It  will  not  be  exposed 

LIQUID-IN4  (NOT  (ATMOSPHERE-CONTACT  OBJECT)); to  the  atmosphere. 

...) 


What  this  states  Is  that  1 f we  wish  to  keep  the  paint  on  the  Instrument  away 
from  the  air,  one  way  to  do  It  is  to  have  It  (the  paint  on  the  Instrument)  In  a 
liquid.  Note  that  while  this  is  on  tlie  right  track.  It  Is  not  exactly  what  we 
want,  which  Is  more  or  on  the  order  of  "put  the  instrument  Into  the  paint".  We 
will  return  to  this  point  momentarily.  (The  reader  may  also  have  noted  that 
LIQUID-IN  Is  rather  different  than  PAINTING.  Indeed  It  Is,  and  as  wc  shall  see, 
STATE  and  COMPLEX-EVENT  are  two  of  five  different  kinds  of  frames  In  the  system, 
but  more  on  this  later.) 


{ 
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A rostrlctlor  placed  on  the  representation  is  that  snyticie  wc  have 
A COMES-FPOM:  ((B)),  It  nust  bo  the  case  that  A matrh« s B In  the  simple  minded 
pattern  matching  sense  of  the  term  (r.g.  compare  PAINTING?  and  LI0UID-IN4  from 
the  last  example).  This  Insures  that  we  have  not  "hidden"  any  Information 
"inside"  the  COMES-FROM  link.  Go  the  Cc'usal  Information  linking  LIQUID-IN  to 
ATMOSPHERE-CONTACT  is  expressed  in  a separate  rule.  and  Is  not  expressed 
directly  by  the  COMES-FROM  link.  The  latter  only  indicates  where  the 
appropriate  Information  Is  to  be  found.  By  using  the  COMES-FROM  link  in  this 
way  wc  arc  serving,  the  cause  of  problem  solvtng  (In  that  we  give  standard 
methods  for  doing,  things  when  they  are  known)  as  well  as  modularity  (in  that  the 
Information  about  non-painting  topics  like  WASH  or  LIQUID-IN  will  be  expressed 
in  frames  of  their  own  where  they  can  be  accessed  by  one  and  all). 

We  noted  earlier  that  our  LIQUID- IN  rule  was  not  exactly  what  v^e  wanted. 
In  fact,  the  LIQUID-IN  rule  is  fine,  but  rather  than  telling  us  to  immerse 
SOME-PAINT,  ”6  rather  want  it  to  suggest  Immersing  INSTRUMENT.  There  is,  of 
course,  a close  connection  between  these  two  possibilities,  since  SOMF-PAINT  Is 
on  the  exterior  of  INSTRUUEftT.  TTpIs  connection  is  expressed  in  the  fo’lowing 
rule : 

(ATMOSPHERE-CONTACT  (STATE) 

VARS;  ... 

RELATIONS:  ... 

( (AND  ATMOSPHERE-CONTACTS  (EXTERIOR  EXT  OBJ)  ;The  exterior  of 

ATMOSPHERE-CONTACT A (ATMOSiniERE-CONTACT  0BJ));an  object  is  ex- 
IFF  ;posed  to  the  sir 

ATMOSPHERE-CONTACTS  (ATMOSPHERE-CONTACT  EXT))  ;lf  the  hjoct  is. 

What  wc  need  to  do  is  Interpose  this  rule  between  PAINTING?  and  LIQUID-IN4. 
That  is,  since  PAIMTlMti?  matchci.  ATMOSPHERE-CONTACTS,  to  prevent  exporure  of 
SOfiE- PA  I NT . wi‘  f'nly  need  to  prevent  ATMOS  PHERF-CONTACTA,  which  we  can  do  by 
Immersing  INSTRUMENT  (vta  1.1  QUl  D-  IN  A ) . We  expn  ss  this  in  PAINTING  as  follows. 


PAINTING?  (NOT  (ATMOSPHFRE-CONTACT  SOMF-PAINT)) 

;IJnrIJ  rtio  Inslrummt  fs  <•  1 . kcop  tho  pnint  on  it  out  i>f  tho  nir- 

COMFF-FROM:  ( ( ATMOSPIIFRF-  COMTAGTI  ATT'OSPHFPF-r.ONTAGTA) 

;Tf  wf  kcop  INSTRirMFNT  out  of  tlic  n 1 r thon  nnythlnp 
;on  it  will  hr  out  of  tlu-  n i r rlf:o, 

(LIQUID- IN4  PAINTINCyC  (LIQUID-IN  INSTRUMENT  PAINT))) 

1 

;so  keep  INSTRUMENT  In  tho  paint. 

I 

i Here  "(ATNCSPHFRF -CONTACTS  ATMOSPHERF- CONTACT4)’'  is  cflltd  an  "intnrmtdiary"  in 

I 

tliat  it  intormi’diatos  bc-iwoon  our  initial  p.oal  PAINTING?,  and  the  way  wo  ocbiovr 
it,  LIQUID-1N4.  Noto  that  our  matching,  r<'Str  ic- 1 ion  still  holds,  though  in  a 
t modified  form.  PAINTING?  matches  ATMOSPHERF- CONTACTS,  while  ATMOSPHERE- C0NTACT4 

I 

j matches  LIQUID-INA- 

i 
i 

t 

1 have  also  introduced  a new  construction  above  in  the  form  of: 

(L1QUID-IN4  PAINT1NG?C  (LIQUID-IN  INSTRUMENT  PAINT))) 

The  problem  Is  that  If  we  are  to  use  the  rules  in  LIQUID- IN  we  must  know  the 
bindings  for  the  variables  In  LIQUID-iN-  Usually  Ms.  Malaprop  can  compute 

' these  automatically  because  of  the  matching  relations.  In  this  cast'  it  Is  not 

I possible,  since  PAINTING?  docs  not  itself  state  what  we  actually  immerse,  or 

what  we  should  immerse  it  in.  To  indicate  these  facts  we  give  a "binder"  or 

"frame  instance"  (in  [10]  1 also  called  these  "frame  images")  for  the  LTQUID-IN 

' frame.  This  is  PAINTING?C.  It  states  that  OBJECT  in  LIQUID-ON  should  be  bound 

I 

^ t ■ to  INSTRUMFNT  and  LIQinp  to  PAINT. 

{ 

1 

LO  111*’  kFAPSrJP  J 

Much  ns  COMES-EKOM  allows  us  to  say  how  a subaction  is  normally 

accomplished,  tin  "LEADS- TO"  llnl  indicates  "why"  an  action  is  performed.  For 
fxanpli  , We  want  to  wash  the  instrument  after  finishing  because  otherwise  it 


will  hecomc  unabsorhciil  . 
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PAINTINCP  (NOT  (STU’KY-ON  r;0^'^  I'AINT  1 NSTKIIMFNT ) ) 

LEADS-TO:  ( (PA INT-DI^ Y 1 ) ) 

(PATNT-DRY  (S IMPl.E-EVENT ) 

VARS:  ... 

EVENT:  (AND  ;If  thiTO  Is  pflnt  stlrUn^ 

PAINT-DRYI  (STlCKY-ON  PAINT  OBJECT)  ;to  /in  object,  and  It  cv/>p- 
PAINT'-DRY2  (EVAPORATION  PAINT)  ) ;oratP8, 

CAUSES 

(AND  ;thpn  tho  paint  will  bocomc 

PAINT-DRY3  (PART-OF  PAINT  OBJECT)  ;part  of  the  object,  /ind  the 
PA1NT-DRY4  (NOT  (ABSORBENT  OB JECT) ) ) ;obJ< c t becomes  unobaorbrnt. 

(Strictly  spe/iUnp,,  PAINTTNCP  docs  not  m/itch  PAINT-DP.Yl,  but  rather  Its 
ncgptlon.  This  Is  taken  can  of  by  the  program  which  reads  In  the  fremes.  See 
section  2 . S .)  Note  that  If  we  have  further  Information  about  EVAPORATION  (as 
Ms.  Malaprop  does)  then  we  can  not  only  understand  why  one  washes  the  paint 
brush,  hut  also  why  It  Is  not  so  cructal  if  one  leaves  the  brush  In  the  paint. 
(No  air  gets  at  the  brush,  preventing  EVAPORATION,  which  in  turn  prevents 
PAINT -DRY. ) 

As  with  COMES-FROM,  the  LEADS-TO  pointer  helps  In  terms  of  MODULARITY  (the 
relevant  Information  Is  found  In  two  frames,  EVAPORATION  and  PAINT-DRY)  and 
problem  solving  (we  are  given.  In  particular,  the  information  needed  to  do  the 
next  example). 

Jack  painted  a chair.  He  wa/i  going  to  throw  the  brush  out. 

He  did  not  wash  I t . 

0:  Wliy  not?  A:  lie  was  going  to  throw  It  out  . 

However  lher«-  Is  another  Interesting  aspect  to  the  LEADS-TO  ’ink.  If  something 
goes  wrong  In  an  action,  or  In  a story  about  an  action,  we  must  b»  ab’r  to 
anticipate  what  will  occur  bec.''use  of  the  mistake.  Tills  came  up  In  an  early 
ex.'tmple  where  someone  did  not  clean  his  brunb  when  done.  Ms.  Malaprop  vrl  11  be 
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f 

i 
i 

I 

.■jblc  to  usp  the  LEADS-TO  link  to  follow  the  r opspqiicr.ef  s . 

There  ere,  of  course,  other  ways  to  acconplish  this  same  end.  The  SAM 
program  (Cullingford  [11])  has  what  are  celled  "interference  paths"  within 

' I 

j "scripts"  (my  complex  event  frames)  to  describe  what  might  go  wrong,  and  whet 

j happens  as  a result-  Both  are  expressed  directly  in  the  script-  From  the  point 

I 

J of  view  taken  here,  the  interference  approach  has  two  problems  v^lth  it.  For  one 

i 

j thing  it  tends  to  defeat  nodularity.  What  goes  wrong  when  we  do  not  wash  the 

; brush  is  exacty  what  goes  right  when  we  let  the  paint  dry  on  the  wa 1 ’ . or 

1 

! whatever  it  is  that  we  paint-  To  express  this  information  twice  (or  more)  seems 

t wastef  ul . 

I 

2. A Types  of  Frames 

During  the  course  of  the  previous  discussion  I introduced  without  comment 
several  different  kinds  of  frames-  We  started  with  PAINTING  which  T call  a 
' COMPLEX-EVENT  frame.  But  we  have  also  seen  SIMPLE-EVENT  frames,  and  STATE 

frames. 

I 

A COMPl, EX-EVENT  frame  is  one  like  PAINTING,  where  the  primary  connective 
betwi^en  sub-events  is  temporal-  That  is.  It  is  of  the  form,  first  do  this,  then 
I do  that..."  In  particular,  note  that  in  PAINTING  there  are  causa]  relations 

' between  the  elements  of  painting  ils<»lf.  Tliis  is  yet  another  restriction  on  the 

I _ representation.  The  idea  is  that  any  time  we  wish  to  slate  a cause  and  effect 

I relation  it  should  he  expressed  in  a separate  frame  since  it  should  apply  to 

i 

! more  than  just  the  particular  situation  given  in  the  COMPLEX- EVENT  frame.  In 

I 

> partlrulnr.  It  will  be  cxprcfiscf'  In  n FTMPLE-EVENT  frnnie.  SIMPLE-EVENTS  consist 

t 

then  i>f  a sing]<  rause  and  effect  relation.  (For  reasons  I no  longer  believe, 

/ 

I 

! 


what  is  intiiltively  a single  rausf'  and  effect  relation  is  currently  expressed 
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ayn  t fir  1 1 r n 1 1 y ;is  tvia  r.'iiiKi'  iirn'l  offrct  rr  1 ;i  t i orifi  • I rhooKc  I o if>porr  this 
complication.)  Should  wo  wish  to  state  that  some-  action  In  a COMPLEX- EVENT  is 
performed  because  of  certain  cause  and  effect  relations  which  It  enablfs,  this 
can  be  expressed  via  a LEADS-TO  link  between  the  sub-event  In  the  COMPLEX- EVENT 
and  the  SIMPLE-EVENT.  Vfhat  this  restriction  does  then  Is  to  enforce  a certain 
type  of  modularity  on  the  representation. 

Another  type  of  frame  which  we  havt'  already  come  across  Is  the  STATE  frame. 
It  describes  a state  much  as  an  event  frame  describes  an  action.  Naturally 
there  Is  no  activity,  but  there*  are  relations  between  the  state  and  other  states 
and  actions,  and  It  Is  these  relations  which  serve  to  define  the  state. 

OBJECT  frames  describe  physical  objects.  They  differ  from,  say,  STATE 
frames  In  that  rather  than  contalnlnp,  relations  to  other  states  they  contain  a 
description  of  the  object  along  with  its  typical  uses.  An  example  Is,  the 
current  (and  Incomplete)  representation  of  PAINT-BRUSH* 


(PAINT-BRUSH  (OBJECT) 

VARS:  (BRUSH) 

(BRISTLES) 

(HANDLE) 

DESCRIPTION: ((SOLID  BRUSH) 

(BRISTLES  BRISTLES)) 
(PART-OF  BRISTLES  BRUSH) 
(SOLID  HANDLE) 

(PART-OF  HANDLE  BRUSH)) 
LEADS-TO:  ( (PAINTINC- BRUSH) ) ) 


;A  paint  brush  is  a soMd  with 
rbrlstles  and  a handle.  I do 
;not  currently  have  a frame  for 
;HANDLE,  so  Its  properties  (SOLID) 
;are  given  here. 

;Typlcally  used  in  PAINTING. 


Tills  should  be  reasonable  clear  save  for  the  last  line,  which  indicates  the 
typical  use  for  paint  brushes.  It  does  so  by  pointing  to  the  line  In  PAINTING 
wliieh  states  that  normally  one  uses  a paint  brush  to  paint  (PAINTING-BRUSH). 
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'rVio  rpm;iln)ng  fr.Trnr  lyp<‘  is  the  ADJUNCT  frnino.  I stated  f.-rllt-r  th?.t 
PAINTING  Is  uncomml t trd  as  to  the  type  of  instrumrnt.  Put  this  by  Itself  Is 
Insufficient*  After  all,  we  do  have  specialized  knowledge  about,  say,  how  to 
use  a roller*  If  PAINTING  is  neutral,  it  cannot  ro  there,  so  we  need  a scrond 
frame,  ROLl-ER-PAINTING,  for  this  Information*  Yet  If  we  are  to  retain 
modularity,  we  do  not  want  to  have  to  repeat  all  of  PAINTING  In  POLLER-PAINTING. 
It  would  be  better  simply  to  say  that  POLLEP-PAINTING  Is  just  like  PAINTING 
except  for  the  following  d I f fereneer.  * Go  the  FVENT  seetlon  eonslsts  of 
referenee  to  PAINTING  - modification  pairs,  i-ach  pair  separated  by  a 


(ROLLER-PAINTING  lADJUNCT) 

VARS:  (INSTRUMENT  ROLLER-PA INTINCC 


;The  Instrument  must  be  a 


(ROLLER  INSTRUMENT)) 
(TRAY  (ROLLER-TRAY  TPAY)) 

MASTER:  PAINTING 

EVENT:  (DURING  PAINTINGS  ROLLER-PA INTINGl ) 
: ROLLER-PAINTIMGl 

(FLUID-CONTAINMENT  TRAY  PAINT) 


; rol Icr  * 

;We  are  mc'difying  PAINTING 
;Durlng  the  main  PAINTING 
;Ioop  make  sure  there  Is 
jpaint  In  the  tray* 


PAINTINGA  COMFS-FROM  : ;We  get  paint  on  the  roller 

((Intermediaries)  ;by  rolling  It  In  the  tray 

(ROLL 3 (ROLL  INSTRUMFNT  TRAY))) 


PAINTINGS  COMES-FROM  : ((ROLL!))  ;We  roll  it  along  the 


;object  to  get  paint  on  It* 


Ms*  Malaprop  ran  use  this  frame  to  handle  rxamples  like: 

Jack  was  painting  a wall.  He  rolled  the  roller  In  the  tray* 
Q:  Has  he  finished  yet?  A:  No* 

Then  he  rolled  the  roller  along  the  wall* 

Q:  Is  this  step  obligatory?  A:  Yes* 
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As  for  how  t ho  ADJUNCT  toohnJquo  oompnros  to  othor  ways  of  aocoitip]  i rhi  ng 
this  sort  of  modularity,  I point  the  Interested  reader  to  a discussion  in  [7]. 

Earlier  I commented  that  predicates  in  the  representation  were  themselves 
Just  frames.  So,  (ATItOSPHEP.E-CONTACT  SOKE-PAINT)  Is  a reference  to  the 

ATMOSPHERE-CONTACT  frame  where  OBJ  is  bound  to  SOME-PAINT.  The  Idee  Is  that 
given  these  bindings  we  may,  if  needed,  infer  new  facts  about  the  situation 

using  the  relations  found  In  the  fr.ame.  Or  to  take  another  example,  (PAINTING 
JACKl  CHAIR  I)  Is  my  representation  for  "Jack  painting  a chair"  (tense  Is 

indicated  separately).  It  states  that  we  have  an  Instance  of  the  PAINTING  frame 
where  AGENT  is  bound  to  JACKl  and  OBJECT  to  CHAIR  1. 

That  each  predicate  Is  a frame  Is  not  a significant  restriction  on  the  form 
of  the  semantic  representation.  This  is  because  my  frames  are  still  so  loosely 
defined  as  to  allow  virtually  anything  to  become  one.  However  it  does  allow  one 
to  distinguish  good  from  bad  "style"  In  the  selection  of  predicates  for  the 

representation  of  facts.  For  example,  the  render  may  have  noted  that  I have  no 
equivalent  of  the  ubiquitous  ISA  predicate.  That  Is,  rather  than: 

(ISA  INSTRUMENT  PAINT-BRUSH) 

I have: 

(PAINT-BRUSH  INSTRUMENT) 

The  reason  is  simply  that  each  frame  Is  a collection  of  knowledge  about  a 
particular  concept.  We  have  a body  of  knowledge  about  paint  brushes,  hence 
PAINT-BRUSH  Is  a predicate  in  the  system*  But  v>hat  knowledge  might  we  have 
about  ISA?  Well.  thiTi'  Is  Inherltiince  of  properties,  but  In  fact  this  Is  not 
simply  ii  property  of  IRA  ns  is  usually  nssttmi-d.  For  example,  if  we  know  that 
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(LIQUID-IN  INSTPUMFNT  PAINT)  wo  or.n  inf  or  farts  about  INSTRUMENT  just  as  ve  can 
with  (PAINT-BRUSH  INSTRUMENT)  or  (ISA  INSTRUMENT  PAINT-BRUSH).  That  Is  to  say. 
the  Inheritance  of  properties  Is  just  a special  case  of  the  inference  of 
properties,  and  as  such  Is  not  a fact  about  ISA.  But  if  there  Is  no  Information 
unique  to  ISA  there  seems  to  be  no  need  for  an  ISA  frame,  and  hence  ISA  should 
not  be  a predicate  In  the  system.  (Later  however  we  will  resurrect  ISA  not  as  a 
predicate,  but  as  a specialized  search  technique,  which  is,  in  fact  what  it 
always  has  been.  That  is,  I am  claiming  that  previous  use  of  ISA  have  confused 
search  techniques  with  predication.)  Unfort unatel y , ISA  is  the  rare  case.  For 
the  most  part  my  frames  say  little  about  which  predicates  are  worth  having. 

2. 5 Impl emen  tail  on 

Barring  a few  minor  complexities  which  I have  left  out,  the  representation 
developed  here  is  exactly  vrhat  Is  given  to  the  system.  It  is  not  however  what 
is  used  during  the  story  comprehension  phase.  In  particular  there  is  a program 
which  takes  the  list  formatted  versions  as  presented  here  end  modifies  these  In 
several  ways. 

The  least  Interesting  change  1s  from  the  Input  list  format  to  property  list 
structures-  Internally  a frame  is  represented  ns  an  atom  with  properties  such 
as  VARS,  EVENT  etc.  A frame  statement  Is  an  atom  (the  name  of  the  statement) 
with  properties  such  as  ROPY  (which  gives  the  predicate  and  arguments) 
COMES-FROM  etc.  Tlu'  program  also  performs  local  syntactic  cbecVlng  (the  atom 
COMF.S-FROM  following  a statement  should  be  interpreted  as  a property  of  that 
statement,  and  not  the  name  of  the  next  statement,  like  PATNTTNC25).  Arguments 
to  predicates  may  he  input  f lih»r  in  positional  notation  (as  Is  predominate  In 
this  paiur)  or  In  "pair"  notation.  However  internally  everything  Is  In  pair 
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nota  t ion . 

At  an  only  slightly  higher  level,  the  frame  input  program  adds  various 
pointers  vohich  make  it  easier  to  examine  things  in  frames-  So,  it  creaies  a 
"frame  index"  which  Indexes  the  frame'  statements  in  a given  frame  according  to 
their  predicates  and  argumrnts-  Thlf;  is  used  when  we  are  looking  for  a 
statement  in  a frame  which  matches  a gtven  statement.  (This  comes  up 
particularly  when  we  are  looking  for  a match  br-tv^een  what  happens  in  the  story 
and  what  we  expect  to  happen  glv'en  our  framed  knowledge.)  We  also  add  b.ack 
pointers  from  individual  statements  to  witere  they  appear  in  the  frame.  Hence, 
given  a COMES-FROM  or  LEADS-TO  pointer  to  a statement  we  can  find  out  the  role 
the  statement  plays  in  the  frame.  For  example.  1 f we  have  a pointer  from  a 
story  statement  describing  "washing  a chair"  to  the  "c'’ran  obiect"  statement  in 
PAINTINC,,  we  will  be  able  to  answer  a question  like  "Has  Jack  finished"  by 
seeing  where  the  "clean  object"  statement  fits  in  PAINTING. 

Somewhat  more  Interesting  are  the  non-local  syntactic  checks  (or  semantic 
checks).  If  we  have  in  PAINTINC  the  command  (STICKY-ON  SOME-PAINT  INSTRUMENT) 
Ms.  Malaprop  will  go  to  the  STICKY-ON  frame  and  look  at  the  strict  requirements 
on  the  variables  and  see  If  SOMF-PAINT  and  INSTRUMENT  satisfy  them.  In  this 
case  she  will  find  in  STICKY-ON  the  following: 

(STICKY -ON  fSTATE) 

VARS:  (LIQ  (LIOUTD  LTQ)) 

(Onj  (SOLID  OBJ)) 

. . . ) 

Ms.  Malaprop  will  then  try  to  prove,  given  f he  information  in  PAINTINC,  the  two 
statements,  (LIQUID  SOMK-PATNT)  and  (SOLID  INSTRUMENT).  In  this  case  it  is 
fairly  strii  Ightforward  (both  are  stated  explicitly  in  PAINTING),  but  in  general 
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this  prorrss  will  rcquirr  Ms.  M.i ! njiri'p ' f inffrrnrc  r.-rp.-ib  i I i t 1 (>5  • Only,  nnw 
Instesd  of  using  the  story  ns  the  brsir  soiiree  of  information,  it  is  the  frome 
itself  which  serves  as  the  data  base. 

A somewhat  similar  situation  is  the  cheching  of  CCMFS-FROll  and  LEADS-TO 
pointers.  1 have  menrion«‘d  that  wlicnever  wi'  ha^'o  STl  COMF?-FP,OM:  ((ST2))  it  is 
required  that  STl  matches  ST2.  That  is,  they  must  both  have  the  same  predicate 
and  non  variable  arguments,  and  the  variable  arguments  must  match  ignoring 
different  names  (and  in  particular  the  absolute  restrictions  on  both  variables 
must  be  compatible).  This  matching  has  a side  effect  however.  Consider  the 
following  case: 


PAINTINCl  (NOT  (STICKY -ON  DIRT  OBJFXT)) 
COMF.S-FROM:  ( (VIASH-OOAI, ) ) 


V.’ASH-OOAE  (NOT  (STICKY -ON  BAD-STUFF  OBJECT)) 


In  matching  PAINTING!  against  WASH-GOAL  we  bind  DIRT  to  BAD-STUFF  end  OBJECT  (in 
PAINTING)  to  OBJECT  (in  WASH).  Tliese  bindings  will  he  recorded  explicitly  in 
PAINTING  so  that  they  need  not  be  re-computed  each  time  we  wish  to  see  if  a 
particular  instance  of  washing  is  plausible  under  the  interpretation  that  it  is 
being  done  in  order  to  get  the  thing  painted  clean.  This  will  give  us: 


PAINTIHf:]  (NOT  fSTTCKY-ON  DIRT  OBJECT)) 

COMF.S-FROM:  ((WASH-GOAl  (WASH  (OBJECT  . OBJECT)  (BADSTUFF  . DIRT)))) 

The  new  lien  hiTo  is  a fram<  statemrnl  which  say.s  that  the  instance  of  washing 
invo]vc<l  will  have  the  following  bindings  ...  . (Remember  that  bindings  arc 
internally  specified  in  pa  • r reflation.) 
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3-  Tlir  BASIC  PROCESS 

Given  this  brief  introduction  to  Ms.  Malaprop's  representation,  let  us  now 
consider  how  the  program  uses  it  to  understand  stories.  The  fundamental  idea, 
which  we  have  been  presupposing  all  along.  Is  simply  this:  statements  from  the 
story  are  "understood"  by  linking  them  to  one  or  more  matching  frame  statements. 
So  wc  understand  the  line  "He  got  some  paint  on  the  brush"  by  seeing  it  as  an 
Instance  of  PA1NT1NG4  which  is  tl.e  command  in  PAIIITINC  tel’lng  one  to  achieve 
STlCKY-ON.  Once  Ms.  Malaprop  has  made  this  connection  she  can.  should  there  be 
a question  on  the  subject,  use  the  information  in  the  fr'>me  to  answer  questions 
about  the  story,  such  as  wiiy  it  was  done,  or  how,  or  wlien.  Note  that  in  general 
these  extra  details  are  not  filled  in  at  read  time  since  they  are  so  easily 
obtainable  from  the  frame.  The  process  of  linking  story  statements  to 
corresponding  frame  statements  will  be  called  "statement  integration". 

Moving  down  one  level  of  detail,  we  can  view  Ms.  Malaprop  as  a combination 
of  three  components. 

SET  UP  STORY  STATEMENTS 


INTEGRATE  STATEMENTS  INTO  FPAMES 


DO  READ  TIME.  INFERENCES 


(There  is  a fourth  separ.cblc  section  of  Ms.  Malaprop,  DEMONSTRATE,  the  function 
In  charge  of  infc'ri’ncc.  It  does  not  fit  into  the  flow  chart  however  since  it  is 
called  by  all  sections  of  the  program.)  ('f  these  we  have  briefly  described 
"sfaieniiU  I n I eg i . 1 1 i on"  . "Set  up"  is  the  usual  sort  of  initial  bookkeeping, 
"head  lime  inferences"  ar»'  tliose  inferences  wc  make  while  reading  because  in  the 
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estimation  of  the  program  they  are  especially  salient  to  the  situation  el  hand - 
Deriding  "saliency"  is  a very  difficult  problem-  (Set'  section  5) 

In  this  section  we  are  primarily  concerned  with  "statement  integration" 
but  for  the  sake  of  completeness  let  us  briefly  consider  what  "set  up"  does - 
Take  the  following  simple  example- 

Jack  was  going  to  paint  a chair  with  a brush.  He  cleaned  the  chair 
Q:  Why?  A:  So  the  paint  will  not  flake- 


As  we  have  already  noted,  the  input  to  the  program  is  not  English  but  a 
semantic  representation,  so  the  first  line  is  actually 

( SS-  1 (INTEND  JACKl 

$ST  SS- 2 (PAINTING  JACKl  CHAIR  1 PAINT  BRUSHl)) 

SS-3  (PERSON  JACKl) 

SS  A (CHAIR  CHAIR  1) 

SS- 5 (PAINT-BRUSH  PAINT- BRUSKl ) 

(SAME- TIME  NEW-NOW  (BEGIN  SS  1 ) ) ) 

Here  SS-1  states  that  Jack  intends  to  do  SS  2.  namely  paint  the  chair-  The 
symbols  SS-1  etc.  are  simply  names  of  the  story  statements  (SS).  SS  3 states 
that  JACKl  is  a person.  It  should  be  remembered  that  save  for  a few  special 
symbols  (NEW-nOW  and  BEGIN  In  the  above  (xample)  all  arguments  to  predicates  ar«- 
arbltr.ary  symbols.  I vlll.  In  general  end  such  arbitrary  symbols  with  numbers 
to  serve  as  a reminder-  The  last  lint'  serves  to  locate  the  events  described  in 
time.  Here  wi-  simpiv  state'  that  "story  now"  (*  NEW-NOW)  is  the  point  where  Jack 
decidc.s  to  do  some  palnting- 


Thrse  statements  will  be  converted  Into  the  internal  format  by  the  same 
program  which  coverts  frame  statements  Into  their  internal  format  (see  section 
2. 3)  a.s  I rame  and  story  statements  are  represented  In  exactly  the  same  way.  At 
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tho  same  Hme  the  story  stalenients  will  bt-  indexed  In  liu-  <lal.i  base  (by  tin  same 
program  which  for  frame  statements  eonstriiets  the  frame  Index)-  Lastly  the 
story  statements  will  have  their  arguments  ehecked  for  correct  types-  That  Is 
If  we  say  that  (ABSORBI'D- BY  A B)  then  A must  be  a liquid  and  B a solid 
(according  to  the  restrictions  on  variables  in  the  ABSORBED- BY  frame)-  Again, 
this  is  done  by  the  same  programs  which  check  frame  statements  for  correct 
argument  types,  but  now  the  basic  source  of  data  about  the  arguments  will  be  the 
story  not  the  frame  in  which  the  statement  appears  These  "setting  up" 
activities  are  summarized  below. 

PUT  LINE  OF  STORY  INTO  INTERNAL  REPRE- 
SENTATION USING  FRAME  PARSER 

Set  up  story  statements (ss)  PUT  STORY  STATEMENT  IN  DATA  BASE  (DONE 

DURING  ABOVIC  PROCESS) 

Integrate  ss's  into  frame  CHECK  IF  ARGUMENTS  ARE  OF  THE  CORRECT 

TYPE  GIVEN  THE  PREDICATE 

Do  read  time  Inferences 

Now  we  try  to  Integrate  the  individual  story  statements  into  tho  frames- 
Tills  is  done  via  a list  of  "context"  statements,  which  are  simply  those  complex 
event  frames  (o-g.  PAINTING)  which  have  been  mentioned  earlier  in  the  story- 
(Since  the  program  only  accepts  very  short  stories  no  attempt  at  forgetting  has 
been  made.)  Obviously  for  the  first  sentence  there  are  no  previously  mentioned 
complex  events.  so  no  aiiempt  at  integration  Is  made-  We  will,  of  course,  add 
SS-2.  I lie  Instant  i-it  Ion  of  the  PAINTING  frame,  to  the  context  list-  We  con  then 
move  on  to  line  two  of  our  story  which  (omitting  tense  information)  goes  as 
foil ows ; 


SS-fi  (CAUSE  .lACKl  ?ST  SS  7 (NOT  (STICKY  ON  (OBJ  . CHAIRl)))) 

Ihls  says.  "Jack  cause  something  (unspecified)  to  not  be  sticking  to  the  chair-" 


|^flll^^■^trrT' 
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(Note  that  since  we  do  not  know  the  first  argument  to  STICKY-ON  the  second 
argument  Is  specified  by  using  an  explicit  pairing  between  the  variable  in  the 
STICKY-ON  frame  (OBJ)  and  Its  binding,  CHAIRl.) 


This  statement  will  be  converted  Into  Internal  format,  asserted.  and 
chocked,  as  before.  However  this  time  when  we  move  on  to  statement  Integration, 
there  will  be  a previously  mentioned  statement  on  the  context  list,  namely  our 
painting  statement-  So  we  start  looking  for  matching  frame  statements  within 
PAINTING.  The  story  statement  we  are  trying  to  match  Is  SS-6,  the  CAUSE 
statement,  but  particular  knowledge  of  the  CAUSE  predication  tells  it  to  Ignore 
the  cause  statement  Itself  and  concentrate  on  the  state  being  caused,  namely 
SS-7  (the  "clean"  statement). 


In  looking  for  a match  within  a frame  we  start  by  finding  all  statements  In 
the  frame  with  the  same  predicate  (Ignoring  any  NOT's).  In  the  present  case  we 
will  find  three  candidates. 


i 

i 

I 

! 


J 


SS-7  (STICKY -ON  ? CHAIRl) 

PAINTING!  (NOT  (STICKY-ON  DIRT  OBJECT))  ;The  Initial  cleaning 

PAINTING4  (STICKY-ON  PAINT  INSTRUMENT)  ;Gettlng  paint  on  initially 

PAINTING6  (NOT  (STICKY -ON  PAINT  INSTRUMENT))  ;Cleanlng  Instrument  after 

We  must  now  match  SS-7  against  each  of  these  to  see  If  there  Is  indeed  a match. 

In  genera)  this  proces  Is  quite  complex,  and  we  will  defer  discussing  It  until 

the  next  section.  B\jt  In  the  present  case  It  Is  quite  easy  to  rule  out 

PAINTINGI  and  PAINTINC6  as  possibilities,  since  making  these  matches  would 
require  matching  INSTRUMENT  with  CHAIRl,  when  It  Is  already  bound  to 

PAINT  llRUSltl.  Remember  that  (PAINTING  JACKl  CHAIRl  PAINT -BRUSHl)  Is  shorthand 
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for : 

(PAINTING  (AGENT  . JACKl)  (OBJECT  . CHAIR  1)  (INSTRUMENT  . PAINT-BRUSH  1 ) ) 

Given  that  these  bindings  are  no  consistent  with  INSTRUMENT  being  bound  to 
CHAIR  1 there  is  not  problem  in  ruling  out  the  undesired  interpretations  of  our 
story  statement- 

Once  we  have  chosen  a matching  frame  statement  we  add  a pointer  to  the 
story  statement  showing  where  It  was  integrated  in  the  context  frame.  In  the 
present  case  we  will  have; 

SS-7  (NOT  (STICKY -ON  (OBJ  . CHAIRl)))  LEADS-TO:  ((PAINTINGl  SS-2)) 

Here  PAINTINGl  is  the  frame  statement  matched  with  SS-7.  The  SS-2  serves  two 
purposes.  For  one  thing  it  indicates  that  we  now  understand  SS-7  as  part  of  the 
particular  act  of  painting  described  in  SS-2  (PAINTING  JACKl  ...)•  Secondly, 
SS-2  gives  the  bindings  of  the  variables  which  were  used  when  we  made  the  match 
between  SS-7  and  PAINTINGl.  Since  the  binding  statement  already  exists,  we  need 
only  give  its  name  here. 

Given  this  pointer  Ms.  Malaprop  is  now  in  position  to  answer  all  sorts  of 
questions  about  SS-7.  Tlie  exact  mechanism  is  not  of  particular  Interest,  but 
uniformly  it  involves  following  the  LEADS-TO  pointer  back  to  PAINTINGl  and  using 
the  formation  there.  To  answer  "why"  Jack  cleaned  the  chair  we  look  at 
PAINTINGl  where  we  see: 

PAINTINGl  (NOT  (STICKY -ON  DIRT  OBJECT))  LEADS-TO:  ((FLAKINGl)) 


This  states  that  PAINTINGl  prevents  flaking  (as  it  matches  the  negation  of  one 
of  1 laUng's  prerequisites,  the  object  having  dirt  on  it).  We  can  now  use  this 
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information  to  explain  Jack's  behavior.  Or  again.  If  we  are  asked  whether  Jack 
has  finished  yet  we  can  use  the  time  relations  in  PAINTING  to  answer  "no".  Or 
yet  again,  if  we  should  be  asked  if  Jack  could  have  omitted  this  step  Ms. 
Malaprop  will  answer  "Yes"  on  the  basis  of  the  relation  between  the  goal  of 
painting  and  PAINTINGl. 

With  these  steps  Included,  our  flow  chart  becomes  the  following: 


LOOK  IN  CURRENTLY  ACTIVE 
COMPLEX  EVENT  FRAMES  FOR 
POTENTIAL  MATCHES. 

SEE  IF  THERE  IS  A MATCH 
GIVEN  BINDINGS  FROM  COM- 
PLEX EVENT  STATEMENTS. 

IF  THERE  IS  A GOOD  MATCH 
ADD  POINTER  FROM  STORY 
STATEMENT  TO  FRAME  STM. 


Convert  to  Internal 
representation . 

Set  up  story  Assert  story  statements, 

statements . 

Check  for  correct 
argument  types. 

Integrate  state- 
ments into  frames. 

, Do  read  time 
Inferences . 


4 THE  MATCHING  PROCESS 


One  of  the  major  problems  in  Artificial  Intelligence  is  that  of 
"recognition":  that  is,  recognizing  that  some  set  of  data  is  an  Instance  of  a 
more  general  case.  This  problem  Is  most  evident  in  medical  diagnosis 
(recognizing  certain  complaints,  test  results,  etc.  as  an  Instance  of  a certain 
disease),  visual  object  recognition,  and  speach  recognition,  but  it  occurs  in 
high  level  language  comprehension  as  well.  One  way  this  occurs  is  the  problem 
of  determining  which  frami'  Is  relevant  to  a given  situation.  At  the  moment  Ms. 
Malaprop  says  nothing  about  this  difficult  problem.  The  program  depends  on  the 
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relevant  framos  bcin><  Instantiated  In  the  Input,  so.  If  PAINTING  Is  to  be 
examined,  we  had  better  mention  that  someone  Is  painting. 

A somewhat  simpler  case  of  the  recognition  problem  comes  up  when  Ms. 

Malaprop  has  to  recognize  that  a given  action  Is  an  Instance  of  some  action 
mentioned  In  a complex  event  frame.  Tills  Is  what  I called  the  "matching" 
problem  In  the  last  section.  There  we  only  considered  a very  simple  case,  now 
we  will  look  Into  some  of  the  complexities. 

Tlte  matching  process  in  Ms.  Malaprop  Is,  In  fact,  two  separate  processes. 

The  first  of  these  rejects  potent  1 a 1 matches  on  the  basis  of  time  Information, 

while  the  second  determines  if  the  frame  variables  match  the  objects  in  the 
story.  Let  us  start  with  time  considerations. 

Jack  finished  painting  a chair.  Then  he,  washed  It. 

Q:  Why?  A:  I don't  know- 

Ms.  Malaprop's  understanding  of  time  Is,  for  the  most  part,  quite  prlmit-lve 

(see  section  6),  but  she  can  handle  this  example.  First  we  must  understand  that 

the  program  does  not  Interpret  "finished  painting"  as  meaning  that  every  action 
In  PAINTING  has  been  completed,  but  only  those  actions  in  what  Is  called  the 
"center"  of  the  frame.  The  center  Is  found  by  first  noting  the  action  which 
directly  leads  to  the  goal  state  of  the  frame.  The  center  then  Is  simply  the 
highest  embedding  I>OOP  (if  any)  around  that  action.  (See  below  for  the  case  of 
PAINTING.)  Given  this  fact,  Ms.  Malaprop  will  reject  all  action  which  occur 
before  or  during  the  center  ns  possible  candidates  for  the  match. 

f 

t 

-j 
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(PAINTING  (COMPLEX-EVENT) 

VARS:  ... 

GOAL:  PAINTING-GOAL  (EXTERIOR  PAINT  OBJECT)  ;The  goal  Is  coating  OBJECT 
COMES-FROM:  (via  Intermediates) 

EVENT:  PAINTINGl  ... 

PAINTING3 

(LOOP  PAINTING4  . . . 

PAINTINGS  (CONTACT  INSTRUMENT  OBJECT) 

...) 

...) 

In  a parallel  fashion,  actions  will  be  rejected  for  being  too  far  along  In 
the  frame.  For  example: 

Jack  was  going  to  paint  a chair.  He  washed  the  brush. 

Q:  Why?  A:  I don't  know. 

Although  one  could  answer  "so  it  Is  clean  before  using  It"  the  Important  point 
for  our  purposes  Is  that  the  brush  cleaning  Is  not  Interpreted  as  the  cleaning 
recommended  at  the  end  of  PAINTING.  Ms.  Malaprop's  rule  here  Is  simply  that  If 
we  are  still  In  the  pre  center  portion  of  the  activity,  all  post-center  actions 
are  rejected. 

A good  example  of  both  of  these  rules  Is  the  following: 

Jack  was  going  to  paint.  He  got  some  newspaper. 

Q:  What  for?  A:  To  cover  near  by  things. 

Jack  finished  painting.  He  got  some  newspaper. 

Q:  Wlint  for?  A:  To  clean  the  paint  brush. 

The  reader  might  note  that  In  the  example  presented  In  the  last  section  (when  we 
were  Integrating  "Jack  cleaned  the  chair"),  the  frame  statement  PAINTING8  (clean 
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tho  Instrumont  aftor)  would  have  boon  rojortod  on  tlmo  considerations  before  wo 
did  any  variable  matching.  It  was  easier  to  ignore  this  point  at  that  time. 

But  the  major  responsibility  of  action  recognition  falls  on  the  variable 
matcher.  In  the  last  section  we  saw  how  Ms.  Malaprop  would  not  Interpret 
cleaning  the  chair  as  failure  to  got  paint  on  the  painting  instrument  because  of 
a mismatch  b»‘tween  CHAIR  I and  PA  INT-BRt'SH  I . So  in  the  simplest  case  an  incoming 
story  statement  will  match  or  fail  to  match  a frame  statement  because  its 
arguments  are  compatible  (or  not)  with  the  bindings  of  the  variables  found  in 
the  frame  statement.  If  we  are  told,  for  example,  that  Jack  was  painting  a wall 
with  a screwdriver,  Ms.  Malaprop  would  have  no  trouble  interpreting  "Jack 
dipped  the  screwdriver  into  the  paint"  as  an  instance  of  "getting  paint  on  the 
Instrument".  If  we  had  not  been  told  what  Instrument  Jack  was  using,  such  an 
interpretation  would  have  been  rejected  on  "likellness"  grounds.  How  such 
"likeliness"  is  Implemented  is  the  topic  of  the  rest  of  this  section. 

The  problem  of  likeliness  comes  into  play  when  we  do  not  know  the  bindings 
for  all  of  the  relevant  variables.  So  consider: 

Jack  was  going  t<i  paint  a chair.  He  dipped  a brush  into  some  paint. 

The  second  line  is  represented  as  Jack  causing  the  brush  to  be  Immersed 
(LlQUID-lN)  the  paint.  ilie  match  between  the  Incommlng  story  statement  and  the 
relevant  frame  statement  goes  as  follows. 

SS3-2  (I.IQUin-IN  PAINT-BBUSHl  PAINTl) 

PAINT1NC4  (LlQHlD-lN  INSTRUMKNT  PAINT) 

Ah  oppo.n'd  to  tlie  pr<>vlou8  cases  however,  here  INSTRUMENT  and  PAINT  arc  not 
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bound,  since  the  statement  about  .lack  painting  did  not  mention  either,  but  only 
the  AGENT  (JACKl)  and  the  OBJECT  (CHAIRl). 

The  reason  "likeliness"  must  come  Into  play  Is  that  the  program  must  not  be 
"fooled"  by  superficially  similar  situations  such  as: 

Jack  was  going  to  do  some  painting-  He  washed  his  hands.  (He  Is  not 

washing  the  OBJECT.  That  is,  he  Is  not  going  to  paint  his  hands.) 

Jack  was  going  to  do  some  painting.  He  dipped  a pencil  In  the  paint. 

(He  is  not  getting  paint  on  INSTRUMENT.) 

To  prevent  such  mismatches  Ms.  Malaprop  places  "llkellness"  restrictions  on 
what  will  be  allowed  to  match  frame  variables.  Most  Important  here  are  the 
normal  conditions  on  variables.  If  the  story  object  satisfies  a normal 
condition  on  the  variable  (with  some  exceptions  to  be  mentioned  later)  then  It 
will  be  allowed  to  match  the  variable.  In  the  case  of  PAINT-BRUSHl  In  the 

example  above,  we  will  be  trying  to  match  INSTRUMENT,  which  has  the  following 
variable  entry: 

(INSTRUMENT  (SOLID  INSTRUMENT) 

NORMAL;  PAINTING-BRUSH  (PAINT-BRUSH  INSTRUMENT) 
PAINTING-ROLLER  (ROLLER  INSTRUMENT) 

PAINTING-ABSORB  (ABSORBANT  INSTRUMENT)) 

PAINT-BRUSHl  will,  of  couse,  satisfy  PAINTING-BRUSH,  and  hence  will  be 
considered  a GOOD  match  for  Instrument.  (As  we  shall  see,  the  matcher  rates 
matches  i-ither  BAD,  POSSIBLE,  SATISFACTORY,  or  (XIOD.  If  the  variable  Is  already 
hound  to  the  oh)rct  It  is  a GOOD  match,  if  It  Is  bound  to  something  else  It  Is 
PAD. 1 It  none  of  the  normal  conditions  are  matched  It  Is  a BAD  match. 
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This  Is  thr  basic  Idea,  but  there  further  cempl leaf  1 ons . For  one  thing, 
Ms.  Malaprop  distinguishes  between  those  normal  conditions  which  specify  what 
kind  of  object  we  want  (a  "roller"  or  a "brush"),  and  those  which  only  describe 
desirable  properties  which  the  object  should  have  ("absorbency").  If  the  only 
satisfied  normal  conditions  are  of  this  latter  type  then  the  match  Is  marked 
POSSIBLE.  The  effect  of  this  is  to  not  make  the  match  initially  but  to  wait  for 
further  evidence  In  the  form  of  a second  attempt  to  make  the  same 
identification.  For  example: 

Jack  was  going  to  paint  a chair.  He  dipped  a sponge  Into  some  paint. 

Q:  Why?  A:  I don't  know. 

Then  he  drew  the  sponge  across  the  chair. 

Q:  Why  did  John  dip  the  sponge  into  the  paint. 

A:  To  get  paint  on  it. 

After  line  two  we  have  made  one  attempt  to  match  SPONGEl  against  INSTRUMENT. 
This  has  produced  a POSSIBLE  rating  for  the  match  of  line  two  aglnst  the  framed 
knowledge  that  dipping  Is  tlie  standard  way  to  get  paint  on  the  instrument. 

However  we  do  not  act  on  this  and  hence  Ms.  Malaprop  cannot  answer  the  first 

question.  When  the  next  line  comes  in  w«-  make  a second  attempt  at  the  match, 

and  this  time  It  goes  through,  allowing  the  program  to  answer  the  question  it 

failed  to  answer  one  line  earlier. 

I will  skip  the  other  complications  except  to  mention  that  if  there  are  no 
normal  conditions  on  a variable  , but  the  absolute  restrictions  are  matched  then 
the  match  Is  graded  SATISFACTORY.  As  described  the  matching  procedure  goes  as 


illustrated  below. 
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Is  VAR  already  bound? 


MATCH  RATE INC 


no 


yes 


Have  we  already  made 
a POSSIBLE  match 
to  STORY-OBJECT? 


To  STORY-OBJECT?  no  BAD 

yes  GOOD 


no  yes 


GOOD 


Does  STORY-OBJECT  satisfy  all  of  the 

necessary  conditions  on  VAR?  no  BAD 


yes 

Are  there  any  normal  conditions  on  VAR?  no  SATISFACTORY 

yes 

Does  STORY-OBJECT  satisfy  any  of  them?  no  BAD 

yes 

Are  any  of  these  conditions  on  the  kind 

of  object  which  is  normally  used  no  POSSIBLE 

yes  GOOD 


Next  we  update  our  flowchart  to  Include  this  sections  additions. 


Find  potential  matches. 

ELIMINATE  THOSE  WHICH  DO 
NOT  FIT  DUE  TO  TIME  CON- 
STRAINTS. 

SEE  IF  THERE  IS  A GOOD, 
SATISFACTORY,  OR  POSSIBLE 
MATCH  ACCORDING  TO  ABOVE. 

IF  ONLY  POSSIBLE,  NOTE, 
BUT  POSTPONE  INTEGRATION, 
ELSE  ADD  LEADS-TO  POINTER 
TO  STORY  STATMFNT. 


Set  up  story 
statements . 


Integrate  state- 
ments Into  frames. 

Do  rend  time 
Inferences . 


Convert  to  Internal 
representation . 

Assert  story  statements. 

Check  for  correct 
argument  types. 


Page  32 


5.  READ  TIME  INFERENCES 

5. 1 Abductlve  and  deduc  five  Inferences 

Most  programs  which  attempt  to  understand  text  make  Inferences  about  the 
text  while  the  program  Is  "reading"  rather  than  always  waiting  until  a question 
Is  asked*  Often  (Indeed  most  of  the  time)  these  Inferences  are  not  In  any  sense 
logically  entailed  by  the  story,  so  the  machine  can  be  though  of  as  "jumping  to 
conclusions"  about  what  Is  being  descrlbcni  in  the  text-  While  it  Is  probably 
not  feasible  to  omit  such  inferences  (see  Charnlak  [12]),  their  use  Is 
problematic  since  one  cannot  make  all  possible  Inferences.  The  question  then 
becomes  which  ones  should  the  program  make? 

Roughly  speaking  wo  can  closlfy  read  time  inferences  Into  two  catagorles, 
"abductlve"  and  "deductive"  Inferences.  So,  for  example,  1 f we  read  that  Prof. 
X submits  a paper  to  a low  status  conference  taking  place  In  Tahiti,  we  might 
make  the  abductlve  (or  "explanatory")  Inference  that  he  Is  primarily  Interesting 
In  a free,  or  at  least  tax  deductible,  trip.  We  are  explaining  his  actions  In 
terms  of  •.  ertaln  motivational  hypotheses.  We  might  also  make  some  deductive 
Inferences  such  as  "he  mailed  a copy  of  the  paper  to  the  program  chairman". 

The  frame  recognition  problem  discussed  in  section  4 Is  one  variety  of 
abductlve  inference,  and  as  1 noted  tlicre,  how  such  Inferences  are  made  Is  a 
tough  problem  and  one  Ms.  Malaprop  does  not  tackle.  Hence  In  this  section  we 
will  be  concerned  with  deductive  inferences. 

While  the  problem  with  abduct ive  inferences  is  how  to  make  them,  the 
problem  with  diductlvc  Inferences  Is  which  ones  to  make.  It  Is  all  too  easy, 
given,  say,  the  fact  that  Jack  Is  a person  to  Infer  that  he  has  a heart,  two 
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arms,  etc.  But  why  bother?  To  answer  this  question  Ms.  Malaprop  Includes  a 
rudimentary  theory  of  deductive  inferences.  In  particular  she  recognizes  three 
types:  "consistency  Inferences",  "unexpected  situations  inferences",  and 
"needed  fact  Inferences". 

The  first  of  these  cares  for  the  rase  where  a new  fact  contradicts  an  old 
one  and  a decision  must  be  made  as  to  which  one  Is  correct.  This  happens,  of 
course,  because  a previous  read  time  inference  Jumped  to  an  incorrect 
conclusion.  The  second  occurs  when  something  unexpected  (according  to  the 
active  frames)  takes  place  and  we  want  to  find  out  what  the  consequents  will  be. 
The  final  one  is  more  complex.  The  general  idea  is  that  the  proper 
representation  for  a situation  will  depend  on  the  context  in  which  the  situation 
is  embedded.  Sometimes  this  is  handled  as  part  of  parsing.  In  Ms.  Malaprop 
this  is  considered  part  of  the  read  time  inference  procedure. 

5. 2 Consistency  and  Unexpec ted  Situation  Inferences 

Consistency  inferences  are  needed  any  time  we  put  something  in  the  data 
base  which  is  the  direct  negation  of  something  we  alreay  know.  If  the  old  fact 
has  been  used  to  make  any  inferences,  new  statements  negating  these  Inferences 
will  be  added  to  the  data  base  causing  the  process  to  be  repeated.  In  order  to 
do  this  Ms.  Malaprop  keeps  what  might  bo  called  "simple  minded"  data 
dependencies.  Tiiat  Is,  any  time  one  fact  is  used  to  Infer  another,  this  is 
recorded  on  botli  facts.  I call  these  "simple  minded"  data  dependences  to 
distinguish  It  from  the  full  fleged  data  dependencies  of  Doyle  [13]  which  are 
also  able  to  handle  cases  wliere  one  fact  was  inferred  from  the  absence  of  a 
second  fact.  The  Doyle  program  also  has  the  ability,  given  a contradiction,  to 
use  the  data  dependencies  to  determine  the  initial  assiimptlons  which  caused  the 
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Inferenro  procodure  to  go  wrong  In  the  first  placo-  Ms.  Malaprop  keeps  track 
of  the  necessary  information  to  do  this,  but  makes  no  use  of  it-  In  the  next 
section  we  will  give  considerable  detail  on  an  example  which  makes  use  of 
consistency  Inferences. 

The  second  kind  of  deductive  Inferences  mentioned  above,  "unexpected 
situation"  Inferences  figures  out  what  will  happen  when  one  of  the  frame 
expectations  is  confounded.  This  is  done  on  the  grounds  that  it  Is  these 
situations  which  are  most  likely  to  bo  Important  In  the  story.  So  for  example, 
we  might  bo  told: 

Jack  was  painting  a chair.  He  had  too  much  paint  on  the  brush. 

Here  the  second  line  Is  understood  by  looking  for  a constraint  which  states  that 
one  should  remain  under  a threshhold  on  the  volume  of  paint  on  the  brush.  If 
this  is  found  we  state  that  his  was  not  done  in  the  current  case.  That  Is,  the 
second  line  Is  interpreted  as: 

(NOT  (THRESHHOLD-UNDER  VOL-PAINT-ON-BRUSHl ) ) 

which  then  matches  the  frame  statement: 

PAINTINC7  (THRESHHOLD-UNDER  SOME-PA INT-VOL)  LEADS-TO:  ((DRIP2)) 

Ms.  Malaprop  will  infer  the  consequences  of  the  disobedience  by  following  the 
LEADS-TO  pointer  attached  to  the  matched  freme  statement.  Ms.  Malaprop 
normally  understands  PAINT1NC7  as  statelng  that  It  Is  designed  to  frustrate  the 
DRIP  process  by  insuring  that  one  of  Its  prerequisites  Is  not  met.  However,  in 
this  case  It  Is,  so  Ms.  Malaprop  asks  the  Inference  maker  (see  section  5.4)  to 
prove  that  the  drip  will  occur. 


IW- 
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(DRIP  (SIMPLE-EVENT) 

VARS:  (LIQ  (LIQUID  LIQ)) 

(OBJ  (SOLID  OBJ)) 

(LIQ-VOL  (VOLUME  LIQ-VOL  LIQ)) 

(LIQ-PART  (AND  (LIQUID  LIQ-PART) 

(PART -OF  LIQ-PART  LIQ))) 

EVENT:  (AND  DRIPl  (STICKY -ON  LIQ  OBJ)  ; If  there  Is  liquid 

DRIP2  ;sticking  to  an  object, 

(NOT  (THRESHHOLD-UNDER  LIQ-VOL)))  ;and  Its  volume  exceeds 
CAUSES  ;a  threshhold,  this  can 

DRIP3  (NOT  (STICKY -ON  LIO-PART  OBJ)))  ;cause  some  of  the  liquid 

;to  separate  off. 


(In  fact,  DRIP2  Is  really  represented  as  "THRESHHOLD-OVER"  rather  than  "NOT 
THRESHHOLD-UNDER"  but  this  would  add  non-essential  complications  to  the 
explanation.)  Proving  that  there  will  be  a drip  Inturn  Involves  proving  that  the 
other  prerequisite  Is  also  true  (DRIPl  (STICKY-ON  LIQ  OBJ)).  This  will  be  easy 
since  part  of  story  Input  will  be  the  definition  of  VOL-PA INT -ON-BRUSH  1 , which 
Is : 


(STICKY -ON  PA  INT -ON -BRUSH!  PA INT-BRUSH 1 ) 
(VOLUME  VOL-PAINT -ON-BRUSH  1 PA INT -ON-BRUSH M 


Hence  Ils  • Malaprop  has  Inferred  that  there  will  be  a drip. 


5. 3 Needed  Fact  Inferences 


The  last  of  the  three  resultant  read  time  Inferences,  "needed  fact 
inferences".  To  see  the  necessity  of  this,  we  should  first  note  that  often  one 
can  make  a large  number  of  Inferences  from  a single  story  statement.  That  X Is 
HUMAN  allows  one  to  Infer  many  structural  properties  of  X.  That  some  object  Is 
LlQUID-IN  some  liquid  allows  one  lo  Infer  STICKY -ON  and  NOT  ATMOSPHERE-CONTACT 
relations,  as  well  ns  a host  of  others  (SURROUND,  DISPLACEMENT  etc.)  not 
currently  Implemented.  Which  of  those  facts  Is  Important  will  differ  from  case 
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to  ease.  One  scheme  would,  of  cotirse,  simply  to  make  all  of  the  Inferences.  My 
guess  is  that  this  Is  In  general  impractical,  but  It  is  Instructive  to  visualize 
how  it  would  work.  In  the  case  at  hand,  the  result  of  this  will  be  to  replace  a 
complex  predicate,  LIQUID-IN,  with  more  basic  ones  (more  basic  in  the  sense  that 
while  LIQUID-IN  iraples  STICKY -ON,  the  reverse  is  not  true).  That  is  to  say,  we 
could  replace  LIQUID-IN  with  a standard  representation  consisting  of  a host  of 
simpler  predicates.  In  such  a case  we  would  not  need  to  Identify  which  fact  is 
needed  in  a given  case,  since  we  would  have  them  all.  Whether  or  not  such  a 
standard  representation  is  logically  possible,  Ir  seems  unlikely  to  be 
hour istically  feasible-  Hence  we  need  some  way  to  Idtntlfy  the  needed  fact  in  a 
given  situation. 

To  take  a particular  example,  early  in  the  event  of  painting,  should  wo 
learn  of  (LIQUID-IN  INSTRUMENT  PAINT)  it  would  be  Important  to  realize  that  this 
will  cause  (STICKY-ON  SOME-PAINT  INSTRUMENT)  for  it  is  this  relation  which  Is 
crutlal  to  our  ability  to  paint.  Later  however,  when  the  painting  proper  is 
done,  we  might  be  more  Interested  in  knowing  that  because  of  LIQUID-ON  the  air 
cannot  dry  out  the  brush.  Ms.  Malaprop  handles  this  problem  by  relying  on  the 
frames  themselves  to  indicate  the'  fact  we  need  to  infer  from  a particular 
predicate  at  any  time.  This  is  done  in  the  following  way.  The  command  in 
PAINTING  telling  us  to  get  paint  on  the  brush  has  the  following  format; 

PAINTING4  (STICKY-ON  SOME-PAINT  INSTRUMENT) 

COMES-FROM;  ((LIQU1D-IN2  PAINTINGAC  (LIQUlD-IN  INSTRUMENT  PAINT))) 

The  COMES-FROM  link  hero  says  that  we  achieve  PAINTING4  through  the  following 


fact : 
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LIQUTD-INl  (LIQUID-IN  OBJ  LIQ) 
CAUSES 

LIQUID-IN2  (STICKY-ON  SOME-LIQ  OBJ) 


More  precisely,  the  COMES-FROM  pointer  says  that  EAINTING4  matches  LIQUID-IN2, 
j where  the  variables  in  the  LlQUID-lN  frame  are  to  be  bound  according  to 

( PA1NTING4C.  The  fact  that  we  achieve  PAINTING4  through  the  rule  taking  one  from 

j LIQUID-INI  to  LIQUID-IN2  is  Implicit  in  the  COMES-FROM  formalism. 

I Now,  to  take  a second,  but  related,  example,  suppose  we  are  at  the  beglnlng 

of  a story  and  we  are  told  that  Jack  dipped  the  brush  into  the  paint.  As 

■ mentioned  earlier,  the  crucial  point  of  "dip"  is  "cause  to  be  LIQUID-IN"  and  at 

i 

I 

some  point  during  the  processing  of  this  sentence  we  will  try  to  Integrated 
(LIQUTD-IN  PAINT -BRUSHl  PAINTl).  Assuming  for  the  moment  that  this  will  be 
matched  with  PAINTING4C,  then  the  fact  that  PAINTING4C  hanges  off  PAINTING4  via 
a COMES-FROM  pointer  will  indicate  to  Ms.  Malaprop  that  PAINTING4  is  the  needed 
fact,  given  that  we  have  seen  LIQUID-IN  in  the  current  situation. 

In  fact,  there  will  be  initially  more  that  one  potential  match  in  PAINTING 
' for  our  LIQUID-IN  story  statement.  The  other  will  be  found  off  PAINTINGP. 

PAINTING?  (NOT  (ATMOSPHERE-CONTACT  SOME-PAINT)) 

COMES-FROM;  ((ATMOSPHERE-CONTACTS  ATMOS PHERE-C0NTACT4 ) 

(LIQUID-1N4  PAINT1NG7C  (LIQUID-IN  INSTRUMENT  PAINT))) 


PAINTING?  is  the  command  which  states  that  after  the  main  painting  loop,  but 
before  washing,  the  paint  on  the  instrument  should  be  kept  out  of  contact  with 
the  air.  The  way  one  normally  docs  this  is  to  leave  the  Instrument  in  the 
paint.  In  the  above  situation  where  we  have  just  started  painting,  Ms. 
Malaprop  will  be  able  to  decide  in  favor  of  PAINTING4C  over  PAINTING8C  as  the 
appropriate  match  on  the  basis  of  time  considerations.  However,  should  we  later 
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be  told  that  Jack  had  finished  painting,  and  then  put  the  brush  In  the  paint,  we 
would  now  match  the  LIQU1I)-IN  story  statement  against  PAINTINC8C,  again  on  the 
grounds  of  approprltate  time  relations.  Furthermore,  since  PAINTING8C  Is 
hanging  off  of  a NOT  ATMOSPHERE-CONTACT  statement,  this  latter  will  now  be  taken 
as  the  needed  fact  given  the  LIQUID-IN  statement. 

With  the  addition  of  the  various  types  of  read  time  Inferences,  our  "flow 
chart"  for  Ms.  Malaprop  appears  below. 


Find  potential 
matches 

Eliminate  some  using 
time  constraints. 

See  If  the  match  Is 
reasonable. 


Set  up  story 
statements . 


Integrate  state- 
ments Into  frames. 


Add  pointer  to  story 

statement  Indlcatelng  Do  read  time 
match.  Inferences. 


Convert  to  Internal 
representation . 

Assert  story  statements. 

Check  for  correct 
argument  types. 


IF  INPUT  CONTRADICTS  PREVIOUS 
INFERENCE,  UPDATE  IT  AND 
ANYTHING  INFERED  FROM  IT. 

IF  IT  CONFOUNDS  FRAME  EXPEC- 
TATIONS. INFER  CONSEQUENCES. 

IF  FRAME  INDICATES  A NEEDED 
FACT,  INFER  IT. 


5.4  The  Inference  Mechanism 


So  far  I have  said  little  about  how  Inference  making  Is  actually  done  In 
Ms.  M;ilaprop.  On  the  other  hand,  the  Inference  mechanism  Is  of  little  Interest 
In  Its  own  right,  except  to  the  degree  that  It  relates  to  the  hlger  level  goals 
of  thi  program,  such  as  restricted  representation  formalism  or  separation  of 
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facts  from  use.  So  we  will  make  a quick  pass  emphasizing  how  its  abilities 
relate  to  the  major  representational  goals. 

Given  some  fact  which  Ms.  Malaprop  would  like  Inferred,  the  inference 
maker  will  call  on  the  following  abilities,  in  roughly  the  following  order: 


Retrieval  from  story  data  base. 

Retrieval  from  active  COMPLEX-EVENT  and  ADJUNCT  frames. 
Use  of  ISA  hierarchy  on  OBJECT  frames. 

Use  of  rules  in  STATE  or  SIMPLE-EVENT  frames. 

Use  of  LISP  programs. 


The  first  of  these  is  properly  speaking  not  an  Inference  technique  at  all.  The 
second  was  mentioned  earlier  (section  2.3)  when  we  noted  how  restricting 
COMPLEX-EVENT  frames  to  the  representation  of  desired  states  of  affairs 
simplifies  the  program  needed  to  Infer  things  from  their  presence  in  a 
COMPLEX-EVENT  frame.  These  two  techniques  are  considered  "low  cost"  techniques, 
and  are  the  only  ones  used  when  the  Inferencer  is  told  to  use  LOW  effort.  The 
rest  are  used  for  NORMAL  effort.  (HIGH  effort  allows  Ms.  Malaprop  to  assume 
things  to  be  true  in  order  to  explain  certain  facts,  hence  giving  Ms.  Malaprop 
a limited  ability  to  do  "explanatory  read  time  inferences"  (see  section  4.1). 
For  example  this  Is  used  In: 


Jack  was  going  to  paint  the  chair  green.  He  got  some  blue  and  yellow 

paint . 

Q:  Why  did  Jack  get  the  yellow  paint?  A:  To  mix  with  the  blue  pain 

t. 


Hrri'  tlic  program  assumed  a "mixing"  action  In  order  to  explain  the  acquisition 
of  the  different  colored  paints.  1 am  ignoring  this  facility  however  because  It 
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Is  quite  ad  hoc.) 

Let  us  assume  that  Ms.  Malaprop  Is  trying  to  prove  (PHYS-OB  PAINT -BRUSHl ) . 
Assuming  the  first  two  technlqes  do  not  work,  she  looks  at  the  frame  for  the 
predicate  Involved  (PHYS-OB)  for  the  section  labeled  IF-NEEDED.  This  section 
can  give  three  kinds  of  recommendations,  one  corresponding  to  each  of  the  last 
three  Inference  methods.  In  the  present  case  we  will  find: 

(PHYS-OB  (STATE) 

VARS:  (OB) 

RELATIONS:  ( PHYS-OB 1 (PHYS-OB  OB) 

IFF 

(OR  PHYS-0B2  (SOLID  OB) 

PHYS-OB3  (LIQUID  OB) 

PHYS-OB4  (GAS  OB)) 

IF-NEEDED:  ((INFER-FROM  PHYS-OBl))) 

The  IF-NEEDED  section  says  to  use  the  above  rule  to  prove  that  something  Is  a 
physical  object.  Like  the  other  pointers,  (e.g.  LEADS-TO)  the  statement 
PHYS-OBl  Is  constrained  to  match  the  statement  composed  of  the  frame  name  plus 
Its  variables.  By  using  this  pointer  we  separate  the  fact  from  the  Information 
on  how  to  use  It. 

Having  located  the  relevant  rule,  the  inferencer  will  try  to  prove  the 
disjunction,  and  In  particular  will  try  to  prove  (SOLID  PAINT -BRUSHl ) . Again 
assuming  this  is  not  In  the  data  base,  the  Inferencer  will  consult  the  SOLID 
Irame,  there  to  find: 

IF-NEEDED:  ((ISA-LINK  SOL)) 

This  states  that  to  prove  something  Is  a solid,  use  the  ISA  inference  method. 
Wliat  this  means  Is  that  the  program  will  look  at  the  OBJECT  frames  which 
describe  SOL  (In  this  case  SOL  will  be  bound  to  PAINT-BRUSHl ) for  a statement 
matcliing  that  which  we  wish  to  prove.  In  this  case  It  will  succeed  in  the 
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PAINT-BRUSH  frame  (see  the  frame  as  given  in  section  2.4).  If  it  had  not,  then 
It  would  have  used  OBJECT  frames  found  in  the  description  section  of  PAINT-BRUSH 
to  continue  the  search.  (This  corresponds  to  the  transitivity  of  ISA.) 

The  banishment  of  the  ISA  predicate  however  has  created  a problem  for  the 
ISA  search  technique.  Typically  we  will  have  stored  several  OBJECT  frames 
describing  the  same  story  object.  So  CHAIR  1 might  be  described  as  a CHAIR,  and 
also  as  a (piece  of)  FURNITURE.  (SOLID,  however  is  a STATE  in  Ms.  Malaprop.) 
This  means  that  the  ISA  technique  might  first  search  FURNITURE,  and  if  that 
failed,  search  CHAIR,  and  then  because  CHAIR  mentions  that  chairs  are  furniture, 
search  FURNITURE  all  over  again.  What  we  need  is  a pointer  to  the  most 
restricted  object  type  we  know  about  a given  story  object.  In  this  case  (CHAIR 
CHAIRI).  The  problem  for  the  frame  representation  Is  the  status  of  this  pointer 
(which  for  the  sake  of  old  times  we  can  call  the  ISA  pointer).  It  should  not  be 
a predicate  for  the  reasons  given  in  section  2.5,  but  what  It  should  "be"  I 
don't  know.  At  any  rate.  It  does  not  exist  In  Ms.  Malaprop,  but  eventually 
something  like  this  Is  going  to  be  needed. 

The  last  of  the  three  techniques  is  the  use  of  a LISP  program  to  decide  the 
issue.  As  1 have  indicated,  my  approach  Is  to  limit  the  use  of  arbitrary 
programs.  At  the  present  time  the  use  of  LISP  code  for  Inference  occurs  In 
three  situations.  The  first  is  the  ad  hoc  uses  (nobody's  perfect),  but  only 
occurs  two  places  in  the  code.  (One  will  be  removed  with  the  addition  of  a 
fourth  IF-NEEDED  type,  PRESUMABLY  (McDermott  [14]),  which  states  that  something 
is  to  be  presumed  true  unless  we  can  show  otherwise.  The  other  has  to  do  with 
the  dlfflcullty  of  representing  information  about  how  colors  mix.  I escaped 
this  problem  by  writing  a LISP  program  which  given  two  colors,  and  a desired 
(Mill  (line,  returns  T If  the  two  colors  wlicn  mixed  will  give  the  third.) 
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Secondly,  LISP  code  Is  used  for  question  answering  routines.  I have  not 
gone  Into  the  method  by  which  Ms.  Malaprop  actually  answers  questions  because 
this  was  not  a major  concern  of  my  research.  What  in  fact  happens  is  that  a 
statement  is  constructed  such  as  (WHY  JACKl  SS2-2  X)  ("X  is  why  JACKl  did 
SS2-2),  and  Ms.  Malaprop  tries  to  "prove  it".  In  the  course  of  this  X will  be 
bound.  To  prove  it  Ms.  Malaprop  consults  the  WHY  "frame"  for  an  IF-NEEDED 
method,  and  finds  the  question  answering  program.  This  is  obviously  ad  hoc,  and 
should  eventually  be  replaced  by  a more  sophisticated  question  answering  system, 
such  as  described  by  Lehnert  [15]. 

Finally  there  is  a class  of  LISP  Inference  rules  which  are  at  least 
defensible.  For  example,  Ms.  Malaprop  in  trying  to  prove  that  an  action  is 
obligatory  in  a given  situation  tries  to  show  that  it  is  needed  in  order  to 
accomplish  the  actor's  goal.  To  do  this  we  need  to  prove  (GOAL  G ACT)  ("G  is 
the  goal  of  action  ACT").  To  do  this  in  turn  we  need  a way  to  retrieve  the  GOAL 
section  of  the  frame  ACT,  and  this  is  most  naturally  done  with  a LISP  program. 
(David  Barstow  has  pointed  out  (personal  communication)  that  this  last  use  of 
LISP  could  also  be  eliminated  by  making  such  predicates  primitives,  in  the  same 
way  as  NOT,  AND,  etc  are  primitive.  In  the  long  run  this  is  probably  the 
correct  thing  to  do,  but  while  everything  is  in  flux,  it  is  easier  to  add  new 
frames  with  LISP  program  IF-NEEDED  methods.) 


1:^. 
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6 AN  EXAMPLE  IN  DETAIL 


To  get  a better  idea  of  how  this  all 
example  and  go  through  It  In  detail.  The 


fits  together, 
example  Is: 


1 et 


us  now  take  one 


Jack  finished  painting.  He  did  not  clean  the  paint  brush. 
Q:  What  happened?  A:  The  brush  became  unabsorbant. 

He  put  the  brush  Into  the  paint. 


Q: 

Did  the  paint  dry  on 

the  brush? 

A:  No 

Q: 

Why  did  Jack  put  the 

brush  In  the 

paint? 

A; 

To  prevent  the  paint 

from  drying. 

The  actual  Input  for  this  Is: 


•.Jack's  painting  activity 

;ls  finished. 

;Now  he 
;falls  to 
;cause 

;the  removal  of 
;the  paint  from 
PAINT-BRUSHl))))  ;the  brush. 

SS-5  (PAINT-BRUSH  PAINT-BRUSHl) 

SS-6  (PAINT  PA INTI) 

SS-7  (PAINT  SOME-PA  INTI) 

SS-8  (PART -OF  SOME- PAINT  I PAINT  1) 

(SAME-TIME  NEW-NOW  (BEGIN  SS-4))  ) 

(ANSWER  (X)(WHAT-HAPPENED  SS-4  X)) 

( (SAME-TIME  OLD-NOW  (BEGIN  SS-10)) 

(BEFORE  (END  SS-1 ) OLD-NOW) 

SS-9  (CAUSE 
JACKl 

$ST  SS-10  (LlQUID-IN  PAINT-BRUSHl 

PAINTl)) 

(SAME-TIME  NEW-NOW  (BEGIN  SS-10))  ) 

(ANSWER  (X)(WHY  JAGKl  SS-9  X))  ) 


;Q:  What  happened  due 
;to  SS-4? 

;Now 

;Jack  causes 

;the  paint  brush  to  be 
;ln  the  paint. 


;Q:  Why  did  he  do  It? 


((SS-1  (PAINTING  JACKl) 

SS-2  (PERSON  JACKl) 

(BEFORE  (END  SS-1)  NEW-NOW)) 

( (SAME-TIME  OLD-NOW  (BEGIN  SS-3)) 
SS-3  (NOT 

(CAUSE  JACKl 

$ST  (NOT  SS-4  (STICKY-ON  1 
SOME-PAINT  1 


■■  igr'v- 
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The  first  line  simply  sets  up  an  Instance  of  the  painting  frame  with  JACKl  as 
the  agent.  The  time  information  states  that  the  action  Is  finished.  (Remember 
that  Ms.  Malaprop  only  assumes  that  the  center  of  the  action  is  finished.) 
Since  prior  to  this  line  there  were  no  complex  events,  there  is  noting  further 
to  be  done  with  this  line,  except  to  note  that  PAINTING  is  Itself  a complex 
event,  and  so  is  put  on  the  context  list. 

Coming  to  line  two,  we  try  to  Integrate  it  Into  PAINTING.  Here  there  is  a 
bit  of  ad  hocery  in  that  (NOT  (CAUSE  (NOT  X)))  is  translated  into  X.  That  is, 
in  the  present  case  the  second  line  becomes,  in  effect  "there  was  paint  on  the 
brush".  Needless  to  say,  this  does  not  capture  the  full  Import  of  the  original 
in  that  it  does  not  suggest  that  the  paint  will  remain  there  although  the 
original  docs  so  suggest.  Even  worse,  Ms.  Malaprop  treats  the  revised  version 
as  if  it  implies  the  paint  will  stay  there.  The  two  mistakes  cancel  each  other 
out,  but  this  is  clearly  a bad  portion  of  the  program.  It  is  all  comparatively 
kludge  free  from  here  on. 

So  the  incoming  line  is  treated  as  if  it  read: 

(STICKY-ON  SOMR-PAINTl  PAINT-BRUSH  1 ) 

This  will  be  matched  against  the  statments  In  PAINTING,  and  simply  on  the  basis 
of  the  predicate,  three  will  be  considered:  the  command  to  clean  the  object, 
the  command  to  get  paint  on  the  Instrument,  and  the  command  to  get  paint  off 
again.  The  first  will  be  eliminated  on  time  grounds  but  it  would  have  been 
eliminated  anyway  since  SOME-PAINT  1 does  not  match  the  variable  DIRT,  and 
PAINT-BRUSH  1 is  a bad  match  for  OBJECT.  Tl»o  second  (get  paint  on  the  brush)  Is 
also  eliminated  on  time  grounds  (given  that  Jack  has  finished,  only  statements 
after  the  renter  will  be  considered).  This  leaves  the  third.  It  will  match 
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because  SOME-PAINTl  Is  a GOOD  match  for  PAINT,  and  PAINT-BRUSHl  is  a GOOD  match 
for  INSTRUMENT  (they  both  satisfy  OBJECT  normal  conditions  on  the  variables). 
The  net  effect  will  be  to  bind  these  two  PAINTING  variables  to  the  story 
objects,  and  to  add  the  following  to  SS-A: 

SS-4  (STICKY -ON  SOME-PAINTl  PAINT-BRUSHl)  LEADS-TO:  ((PAINTING?  SS-1)) 

We  then  move  on  to  do  read  time  inference.  Here  we  note  that  SS-4  is  in  fact 
the  negative  of  PAINTING?,  and  hence  represents  something  we  were  not  expecting. 
So  Ms.  Malaprop  tries  to  find  out  what  will  happen.  She  does  this  by  following 
the  LEADS-TO  pointer  on  PAINTINGS. 


PAINTING?  (NOT  (STICKY -ON  PAINT  INSTRUMENT)) 
LEADS-TO:  ( (PAINT -DRYl  PAINT -DRY4) 

(PAINTING-ABSORB)) 


(In  section  2 I gave  PAINTING?  without  the  intermediary,  but  this  was  only  to 
simplify  discussion.)  What  the  LEADS-TO  says  is  that  PAINTING?  leads  to  the 
negation  of  PAINT-DRYl  which  via  the  rule  of  paint  drying  can  cause  PAINT-DRY4, 
which  Inturn  matches  the  negation  of  PAINTING-ABSORB  (the  requirement  that  the 
Instrument  be  absorbent).  Or  to  put  this  more  succinctly,  if  we  clean  the 
instrument  we  prevent  the  paint  from  drying  on  it  which  would  cause  loss  of 
Instrument  absorbency. 


EVENT:  (AND  ;If  there  is  paint  sticking 

PAINT-DRYl  (STICKY-ON  PAINT  OBJECT)  ;to  an  object,  and  it  evap- 
PAINT-DRY2  (EVAPORATION  PAINT)  ) ;orates, 

CAUSES 

(AND  ;then  the  paint  will  become 

PAINT-DRY3  (PART -OF  PAINT  OBJECT)  ;part  of  the  object,  and  the 
PAINT-DRY4  (NOT  (APSORBANT  OB JECT) ) ) ;obj ec t becomes  unabsorbent. 


Ms.  Malaprop  wants  to  use  this  structure  to  understand  what  will  occur.  What 
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she  does  Is  to  try  to  prove  that  (NOT  PAINTTNG-ABSORB)  will  occur.  The  presence 
of  the  intermediaries  indicate  that  she  cannot  do  this  directly,  but  must  first 
prove  that  the  intermediary  relation  holds,  which  Involves  proving  that 
PAINT -DRY4  will  occur.  To  do  this  she  needs  to  prove  PAINT-DRYl  and  PAINT-DRY2. 
She  already  has  PAINT-DRYl,  that  is  what  started  this  In  the  first  place.  She 
now  tries  to  prove  that  the  paint  will  evaporate.  This  is  not  in  the  data  base, 
nor  is  It  to  be  found  in  PAINTING  Itself.  So  Ms.  Malaprop  goes  to  the 
EVAPORATION  frame  looking  for  advice.  There  she  finds. 


(EVAPORATION  (SIMPLE-EVENT) 

VARS:  (LIQ  (LI()UID  LIQ)) 

EVENT:  EVAPl  (ATMOSPHERE-CONTACT  LIQ)  ;Being  in  contact  with 

CAUSES  ;the  air  causes  a 

EVAP2  (EVAPORATION  LIQ)  ; 1 iquid  to  evaporate. 

IF-NEEDED:  ((INFER-FROM  EVAP2))) 


The  IF-NEEDED  advice  is  to  prove  EVAPORATION  by  proving  ATMOSPHERE-CONTACT. 
This  is  not  in  the  data  base  either,  but  in  ATMOSPHERE-CONTACT  we  find: 


(ATMOSPHERE-CONTACT  (STATE) 

VARS:  (OBJ  (PHYS-OB  OBJ)) 

(EXT  (PHYS-OB  EXT)) 

RELATIONS: 

( ATMOSPHERE-CONTACT  1 (PHYS-OB  OBJ)  ;Things  are  usu- 

IMPLIRS  SOMETIMES  ;ally  exposed  to 

ATMOSPHERE-CONTACT 2 (ATMOSPHERE-CONTACT  OBJ))  ;the  atmosphere. 

( (AND  ATMOSPHERE-CONTACTS  (EXTERIOR  EOT  OBJ)  ;The  exterior  of 

ATMOSPHERE-CONTACT 4 (ATMOSPHERE-CONTACT  OB J) ) ;somethlng  is  in 
IFF  ;contact  with  the 

ATMOSPHERE-CONTACTS  (ATMOSPHERE-CONTACT  EOT))  ;atmo8phere  if  the 
IF-NEEDED:  ((INFER-FROM  ATMOS PHERE-C0NTACT2 ) ) ;obJect  is. 


Tlte  IF-NEEDED  tells  us  to  use  the  first  rule,  so  we  do  so.  This  rule  simply 
requires  that  OBJ  Is  a physical  ob.lert,  which  of  course,  SOME-PAINTl  is.  (In 
fa<  t , given  that  OBJ  is  defined  as  a PHYS-OB,  ATMOSPHERE-CONTACT  I will  always  be 
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true.  The  reason  it  Is  there  Is  bcrnuse  the  representation  has  no  facilities 
for  expressing  facts  except  as  implications,  something  which  must  eventually  be 
corrected.)  However,  note  that  this  rule  is  marked  SOMETIMES.  The  procedural 
correlate  of  this  is  that  before  we  use  the  rule,  the  Inferencer  first  tries  to 
prove  (using  LOW  effort)  that  PAINT-BRUSHl  is  not  in  contact  with  the 
atmosphere.  This  will  fall,  so  wc  then  use  rule  1 and  infer  (ATMOSPHERE-CONTACT 
SOME-PAINT]).  This  in  turn  is  used  by  EVAPl  to  infer  (EVAPORATION  SOME-PAINT  1 ) , 
which  in  turn  is  used  by  PAINT -DRY2,  an  enables  us  to  prove,  as  we  set  out  to 
do,  PAINT -DRY4.  In  the  course  of  doing  this  we  will  keep  track  in  the  data  base 
how  we  inferred  each  fact  using  COMES-FROM  pointers  to  show  the  rule  used  for 
inferring  a certain  fact,  and  LEADS-TO  to  show  what  was  deduced  from  the  fact. 
The  net  result  of  this  will  be  the  appearance  of  the  following  statements  in  the 
data  base: 


SS-4  (STICKY -ON  SOME-PAINT  1 PAINT-BRUSHl) 
LEADS-TO:  (AND  ((PAINTING6  SS-1)) 

((PAINT-DRYl  SD-1))) 

SD-1  (PAINT -DRY  SOME-PAINT  1 PAINT-BRUSHl) 


SD-2  (EVAPORATION  SOME-PAINT  1) 
COMES-FROM:  ((EVAP2  SD-2)) 
LEADS-TO:  (( PAINT -DR Y2  SD-1)) 


;This  leads  to  both  the  negation 
;of  the  command  in  PAINTING  and 
;a  pre-requisite  of  PAINT-DRY. 

;Thls  statement  serves  to  bind 
;the  variables  in  PAINT-DRY. 

;SD-2  is  Inferred  from  the  rule 
;whlch  Includes  EVAP2  with  SD-2 
;a8  binder. 


SD-3  (ATMOSPHERE-CONTACT  SOME-PA  INTI) 

COMES-FROM:  ( ( ATM0SPHERE-C0NTACT2  SD-3)) 
LEADS-TO:  ((EVAPl  SD-2)) 


SD-4  (NOT  (ABSORBANT  PAINT-BRUSHl)) 
COMES-FROM:  ( (PAINT -DRY4  DS-1)) 
LEADS-TO:  ( (PA INTI NG-AB SORB  SS-1)) 


Now  we  get  the  question,  "What  happened".  (Note  that  this  is  given  to  the 
program  in  the  form  "what  happened  due  to  not  cleaning  the  brush".)  Ms. 
Malaprop  simply  needs  to  follow  the  LEADS-TO  chain  from  SS-1  to  SD-4  to  get  the 
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answo  r . 


Wo  first  attempt  to  integrate  SS-9  which  is  the  statement  that  Jack  caused 
SS-10  (LIQUID-TN  PAINT -BRUSHl  PAINTl).  So  we  integrate  SS-10,  and  find  two 
matches  in  PAINTING,  one  concerned  with  getting  paint  on  the  brush,  the  other 
with  keeping  air  away  from  It.  By  time  considerations  we  choose  the  second, 
PAINTING7C  which  appears  in: 


PAINTING?  (NOT  (ATMOSPHERE-CONTACT  SOME-PAINT)) 

COMES-FROM:  ((ATMOSPHERE-CONTACTS  ATMOS PHERE-C0NTACT4) 

(LIQUID-IN4  PAINTING7C  (LIQUID-IN  INSTRUMENT  PAINT))) 


This  is  one  of  those  cases  which  call  for  a needed  fact  Inference,  in  this  case 
to  infer  NOT  ATMOSPHERE-CONTACT.  Again  we  have  to  go  through  an  intermediary 
which  states  that  something  is  in  contact  with  the  atmosphere  if  and  only  If  its 
exterior  is.  Without  going  through  all  the  steps  we  get: 


SS-10  (LIQUID-IN  PAINT -BRUSHl  PAINTl)  ;That  the  brush  is  In  the  paint 

LEADS-TO:  (AND  ((PAINTING7C  SS-1)  ;satlsfles  the  prerequslte 

((LIQUID-INI  SS-10)))  ;LIQUID-IN1 

SD-5  (NOT (ATMOSPHERE-CONTACT  PAINT -BRUSHl ) ;whlch  allows  us  to  infer 

COMES-FROM:  ((LIQUID-IN4  SS-10))  tno  ATMOSPHERE-CONTACT  for  the 

LEADS-TO:  ( (ATM0SPHERE-C0NTACT4  SD-5))  ;brush,  which  Inturn  Implies 

SD-6  (NOT (ATMOSPHERE-CONTACT  SOME-PAINT  I )); the  same  for  the  paint. 

COMES-FROM:  ((ATMOSPHERE-CONTACTS  SD-5)); (The  significance  of  this  LEADS- 
LEADS-TO:  ((EVAPl  SD-7))  ; -TO  will  be  explained  shortly.) 


SD-6  however  directly  contradicts  SD-3,  so  we  do  contradiction  read  time 
inferences  to  clear  up  tlie  problem.  We  first  indicate  that  SD-3  Is  updated. 


SD-3  (ATMOSPHERE-CONTACT  SOM  E-PA 1 NT  1 ) 

COMES-FROM:  ( ( ATM0SPHERE-C0NTACT2  SD-3)) 
LEADS-TO:  ((EVAPl  SD-2)) 

III’DATED-BY:  ((SD-5)) 
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However,  SD-3  LEADS-TO  further  Inferenres,  so  they  too  must  be  updated.  This 
will  give  us: 


SD-2  (EVAPORATION  SOME-PAINT  1) 
COMES-FROM:  ((EVAP2  SD-2)) 
LEADS-TO:  ((PAINT-DRY2  SD-l)) 
UPDATED-BY:  ((SD-7)) 


; Since  we  Inferred  EVAPORATION  it  must 
;be  updated.  To  do  this  we  add 
;lts  negation,  SD-7.  Also,  we  must 
;now  follow  the  consequences  of  SD-2. 


SD-4  (NOT  (ABSORBANT  PA INT -BRUSH  1 ) ) ;whlch  happens  to  be  SD-4. 
COMES-FROM:  ((PA1NT-DRY4  SD-l)) 

LEADS-TO:  ( (PA INTI NG-AB SORB  SS-1)) 

UPDATED-BY:  ((SD-8)) 


SD-7  (NOT  (EVAPORATION  SOME-PAINT  1 )) ;SD-7  and  8 update  SD-2  and  4 
COMES-FROM:  ((EVAP2  SD-6)) 

LEADS-TO;  ((PAINT -DRY2  SD-9))  ;SD-9  is  the  negation  of  PAINT -DRY. 

;Exactly  how  It  Is  Inferred  is  a compll- 
SD-7  (ABSORBANT  PA INT -BRUSH  1 ) ;cat1on  I would  rather  ignore. 

COMES-FROM:  (( PAINT -DR Y4  SD-8)) 


Note  that  the  COMES-FROM  link  on  SD-7  indicates  that  it  was  Inferred  via  tue 
rule  which  Includes  EVAP2.  This  is  also  the  point  of  the  LEADS-TO  link  on  S-6. 
Together  they  state  that  since  there  is  no  longer  atmosphere  contact,  there  is 
no  longer  evaporation. 


We  now  have  corrected  our  false  conclusion.  So  when  the  next  line  comes 
in,  the  question  "Did  the  brush  become  unabsorbant ? " there  is  no  problem  in 
answering  "No". 


7.  MALAPROPISMS 


Like  virtually  all  experimental  comprehension  systems,  Ms.  Malaprop  is  a 
very  delicate  cre.-iture  because  of  various  problems.  We  will  start  will  problems 
with  the  program  proper. 
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7 ■ 1 Problems  with  the  Prog  ram 

het  us  consider  a few  examples  wliich  Ks . Malaprop  will  screw  up,  and  will 
screw  up  In  ways  one  would  never  anticipate  on  the  basis  of  the  previous 
discussion . 


Jack  was  going  to  paint.  He  cleaned  the  brush. 

Q:  Why?  A:  In  order  not  to  have  paint  on  the  brush. 

This  example  is  especially  surprising  since  T claimed  earlier  that  I did  not 
want  Ms.  Malaprop  to  be  fooled  by  "Jack  was  going  to  paint.  Ho  WASHED  the 
brush."  Indeed,  Ms.  Malaprop  will  work  fine  on  this  example,  but  the  seemingly 
small  difference  between  "clean"  and  "wash"  is  enough  to  cause  havoc. 

To  understand  what  Is  happening  we  must  first  know  that  while  "wash"  Is 
represented  by  the  frame  WASH,  "clean"  Is  represented  by  a statement  of  the  form 
"cause  an  unmentloned  fluid  not  to  be  STICKY-ON  the  thing  cleaned".  This  Is,  to 
a first  approximation,  quite  reasonable,  at  least  given  the  representation 
assumptions  which  underlie  the  program.  As  far  as  I can  tell  there  Is  no 
general  knowledge  of  "cleaning"  to  warrant  a separate  frame,  hence  "clean"  Is 
not  a predicate  In  Its  own  right.  "Wash"  however  Is  quite  different.  To 
perform  this  action  we  typically  get  a cleaning  fluid  STICKY-ON  (and  perphaps 
ABSORBED-BY)  the  object  (put  the  clothes  in  the  washer  and  let  the  water  run 
in).  Frequently  If  the  cleaning  fluid  is  water  we  will  mix  soap  with  It.  Then 
we  try  to  bring  about  homogenity  between  the  cleaning  fluid  and  the  "bad  stuff" 
on  the  object  ...  So  the  distinction  between  wash  and  clean  Is  fine. 


■ 'i'.  '5-w  *>i: 


Pago  51 


The  trouble  arises  then  when  wo  try  to  Integrate  the  "clean"  statement- 

(CAUSE  JACKl  (NOT  (STICKY -ON  (OBJECT  PA INT-BRUSH 1 ) ) ) ) . 

CAUSE  simply  says  to  Integrate  NOT  STICKY-ON.  On  the  basis  of  the  predicate 
there  arc  three  possibilities,  the  Initial  and  final  cleaning,  and  the  getting 
paint  on  the  brush  In  the  center  of  PAINTING.  We  quickly  eliminate  the  final 
clean  on  the  basis  of  time,  and  the  Initial  cleaning  since  PAINT-BRUSHl  Is  not 
something  one  normally  paints.  llils  leaves  PAINTING4  (getting  paint  on  the 
brush),  and  unfortunately  there  Is  a match,  since  PAINT-BRUSHl  Is  a very  good 
INSTRUMENT,  and  our  definition  of  "clean"  leaves  the  fluid  tinmentloned , so  the 
matcher  figures  It  might,  after  all,  be  paint!  We  then  link  the  NOT  STICKY-ON 
statement  with  PAINTINC4.  Of  course.  It  matches  the  negation  of  PAINTING4,  but 
this  only  means  that  a frame  expectation  was  confounded.  Then  when  we  ask  the 
question  ...  Well,  I am  sure  you  can  Imagine  the  rest. 

Part  of  the  problem  Is  one  which  came  up  earlier  In  the  distinction  between 
(NOT  (CAUSE  X))  and  (CAUSE  (NOT  X)).  At  the  moment  Ms.  Nalaprop  does  not 
distinguish  them.  Note  that  If  we  had  said  "Jack  was  not  able  to  get  anything 
on  the  brush",  wo  could  reasonably  Interpret  this  as  saying  that  PAINTING4  was 
not  achieved.  That  Is  to  say,  wc  should  count  (NOT  (CAUSE  X))  as  confounding 
our  X pectatlons,  but  not  (CAUSE  (NOT  X)).  (Actually,  things  are  more 
complicated.  A better  statement  would  be  that  (NOT  (CAUSE  X))  should  be 
considered  a better  match  than  (CAUSE  (NOT  X)).)  Another  part  of  the  problem  Is 
that  whenever  we  say  (CAUSE  (NOT  X))  there  Is  an  assumption  that  X was 
previously  true.  In  particular  "clean  Y"  suggests  something  is  STICKY-ON  Y.  If 
we  were  able  to  express  and  use  this  fact  It  would  also  help  deciding  that 
PA1NT1N(;4  Is  not  a good  match  since  If  the  PAINT  were  already  STlCKY-ON 
INSTRUMENT,  there  would  be  no  reason  to  Invoke  PAINTINC4  In  the  first  place. 
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Another  problem  with  Ms.  Malaprop  is  tlie  lark  of  good  facilities  for 

handling  time.  Consider  tlie  following  example: 

Jack  was  painting  a chair.  He  dipped  the  brush  Into  the  paint- 

Some  time  later  he  finished.  Ho  washed  the  brush. 

Q;  Was  there  paint  <in  tin*  brush  before  Jack  washed  It?  A:  No 

There  are  several  problems  here,  but  they  all  revolve  around  the  problem  of 
time.  Tlie  most  Immediate  problem  Is  that  at  the  present  time,  when  we  learn 
that  Jack  washed  the  brush,  Ms.  Malaprop  Infers  (NOT  (STICKY-ON  PAINTl  BRUSHI)) 
via  a needed  fact  Inference.  This  Is  fine,  but  troubles  occur  when  Ms. 
Malaprop  notes  that  this  contradicts  the  (STICKY -ON  PAINTl  BRUSHI)  statement 
which  was  Inferred  (need«*d  fact  again)  In  line  two.  Ms.  Malaprop  assumes  that 
the  former  line  was  never  true,  and  that  we  simply  made  a mistake  In  the 

Inference.  This  covild  be  correct,  providing  we  put  In  the  machinery  to  see  If 
the  two  statements  are  meant  to  be  true  at  the  same  time.  This  could  be  done, 

although  It  will  not  be  simple  to  get  things  so  that  this  example  would  be 

considered  an  update,  while  the  example  of  the  last  section, 
( ATMOSPHERE -CONTACT ) , would  be  considered  a contrad let  Ion - 

With  this  plus  a few  more  corrections  this  example  could  be  answered 
correctly.  But  only  because  the  situation  Is  a particularly  simple  one. 
Malaprop  Is  missing  one  crucial  tiling:  backup.  To  see  why  this  Is  Important, 
one  only  need  consider  situations  wlieri'  there  Is  more  than  one  occasion  where 
paint  was  on  the  brush.  Ms.  Malaprop  handles  time  by  adding  separate 
statements  wlilch  state  that  some  other  statement  was  true  at  a certain  time. 
Given  this  method  of  handletng  time,  when  we  look  for  a STICKY-ON  statement  we 
will  first  find  one  of  them.  We  will  then  see  If  the  time  of  this  one  Is  what 
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VO  want  I and  if  It  Isn't  wo  then  tiavo  to  onnsldor  another  of  the  occasions-  It 
is  this  kind  of  situation,  whore  wo  have  no  way  of  Intelligently  guiding  the 
computer  to  finding  the  right  answer  first,  that  backup  Is  useful.  Its  lack  in 
Ms.  Malaprop  is  a major  reason  wliy  I have  not  bother  to  Improve  the  time 
fac i 1 i t i es  . 

But  probably  the  major  problem  with  Ms.  Malaprop  is  that  of  search.  This 
became  particularly  apparent  wlion  I tried  switching  to  the  domain  of  restaurants 
to  see  to  what  degree  the  programs  design  was  Influenced  by  the  domain  of 
painting.  The  results  were  mixed.  However,  for  the  most  part  the  problems  were 
with  the  program  rather  than  the  representation.  (As  should  become  apparent 
from  the  d 1 f f Icul 1 t ies  1 mention,  1 have  not  run  Ms.  Malaprop  on  restaurant 
stories.)  Of  these,  the  two  most  crucial  problems  where  time,  which  we  have 
already  noted,  and  search. 

The  search  problem  is.  In  essence,  where  shall  we  go  when  looking  for  frame 
statements  which  match  the  input.  I have  not  discussed  the  issue  much  here,  but 
as  should  be  clear  from  the  previous  discussion,  Ms.  Malaprop  only  looks  in 
currently  active  COMPI.EX-E VKNT  frames.  This  worked  for  p.alntlng  given  a little 
fined  tuning  such  as  allowing  matches  against  binders  for  frames  pointed  to  by 
LEADS-TO  or  COMES-FROM  pointers,  e.g.,  (LIQUID-IN  INSTRUMENT  PAINT).  With 
restaurants  however,  this  will  not  work  unless  we  are  willing  to  put  up  with  a 
very  high  degree  of  repeated,  non-modular,  information  (which  Is,  In  fact,  what 
SAM  111]  does).  For  example,  consider  the  story; 

Jack  went  to  a restaurant.  The  menu  was  In  Chinese. 

Q:  Did  lack  liave  any  trouble?  A:  He  did  not  know  what  to  order. 


To  handle  this,  we  would  start  with  something  like  the  following  piece  of  the 
restaurant  frame.  • 


(KNOW  AGENT  MENU)  COMES-FROM:  ( (RF.ADING3) ) 


Plus  we  would  need  the  following  more  general  frames: 


(READING  (SIMPLE -EVENT) 

VARS : ... 

EVENT:  (AND  RFADINGl  (SEE  READER  READ) 

READING2  (KNOW-LANGUAGE  READER  LANGUAGE-OF-READ) ) 
GAUSE 

READING3  (KNOW  RFJVDER  READ)) 

(KNOW-LANGUAGE  (STATE) 

VARS : ... 

EVENT:  KNOW-Ll  (KNOW-LANGUAGE  AGENT  LANGUAGE) 

IFF  (SOMETIMES) 

KN0W-L2  (EQUAL  LANGUAGE  'ENGLISH)  ) 


(Needless  to  say<  the  specifics  of  BEADING  and  KNOW-LANGUAGE  should  not  be  taken 
seriously.)  To  handle  the  above  example,  Malaprop  should  make  a needed  fact  read 
time  Inference  to  the  effect  that  the  agent  will  not  know  the  menu.  The  problem 
Is  that  the  Input  does  not  match  anything  In  RESTAURANT,  but  rather  the  negation 
of  KN0W-L2,  which  Is  two  levels  below  RESTAURANT.  Unless  we  make  it  a standard 
practice  to  search  subframes  of  complex-event  frames  or,  as  seems  more 
reasonable,  allow  for  more  "bottom  up"  kinds  of  search  this  match,  and  the 
consequent  needed  fact  Inference,  will  never  be  made.  (I  might  note  that  In  a 
previous  paper  (16)  1 introduced  llie  notion  of  a "restricted  search"  In  order  to 
handle  some  of  the  search  problems  In  Ms.  Malaprop.  Tills  was  Implemented,  but 
has  not  proved  general  enough  and  In  particular  will  not  handle  the  above 
ex amp  1 e . ) 
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^ ._2  Probl  omfi  with  Know!  pHrp 

A second  problem  with  the  current  pr<iRram  Is  that  some  of  the  knowledge 
encouded  In  the  frames  ts  not  really  correct.  By  this  I do  not  mean  that  It  Is 
not  scientifically  correct,  but  rather  tlint  It  does  not  corespond  to  our  common 
sense  understanding  of  the  situation.  Let  me  restrict  myself  to  one  such 
example.  The  reader  may  have  noted  some  problems  In  our  definition  of 
PAINT -DRY,  which  we  saw  In  section  2.3. 


(PAINT -DRY  (SIMPhK -EVENT) 

VARS:  ... 

EVENT;  (AND  ;lf  there  Is  paint  sticking 

PAINT -DRYl  (STICKY -ON  PAINT  OBJECT)  ;to  an  object,  and  It  evap- 
PAINT-DRY2  (EVAPORATION  PAINT)  ) ;orates, 

CAUSES 

(AND  ;then  the  paint  will  become 

PAINT-DRY3  (PART -OF  PAINT  OBJECT)  ;part  of  the  object,  and  tl.o 
PAINT-DRY4  (NOT  (ABSORBENT  OBJECT) )) ;object  becomes  unabsorbent. 


Tlie  first  thing  which  might  attract  your  attention  Is  that  everything  except  for 
EVAPORATION  Is  a state.  Wliy  Is  there  this  exception.  But  as  soon  as  one  focues 
on  this  part  of  the  rule.  It  should  become  clear  that  as  It  stands  the  rule  Is 
Incorrect.  The  paint  does  not  dry  If  there  Is  any  amount  of  evaporation,  as  the 
rule  states,  but  only  If  the  paint  completely  evaporates  away. 


A way  around  this  problem,  which  would  at  the  same  time  make  things 
unlformaly  states,  would  he  1 1>  replace  EVAPORATION  which  a statement  which  says. 
In  effect,  that  the  paint  must  he  evaporatj'd  away  (a  state).  The  only  reason  I 
did  not  do  this  Is  that  the  best  way  to  state  this  is  by  no  means  obvious,  and 
the  extra  work  would  not  show  any  Imedlate  payoff.  A first  approximation  would 
be  to  state  that  the  volume  of  tlic  p.ilnt  should  be  reduced  to  zero.  The  problem 
here  Is  that  li  l^r.nores  the  volinne  of  the  paint  residue.  One  might  then  say 


that  paint  consists  of  a liquid  part  and  a solid  part,  and  the  condition  Is  that 
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the  volume  of  the  liquid  part  should  be  reduced  to  zero.  Or  should  we  say  that 
the  liquid  part  simply  ceases  to  exist.  Or  should  we  velw  paint  as  simply  a 
liquid,  which,  under  the  appropriate  circumstances  turns  Into  a solid?  In  this 
case  the  the  condition  In  PAINT-DRY  should  be  that  the  paint  Is  a solid. 
Furthermore,  what  are  the  conditions  under  which  the  liquid  part  goes  away  or 
the  paint  becomes  a solid?  Well  It  must  be  exposed  long  enough  to  the  air  and 
hence  evaporate.  But  how  long  Is  long  enough?  Well,  It  depends  on  the  volume 
of  liquid  and  the  circulation  of  air,  and  the  temperature.  How  much  on  each? 
What  are  the  constants  of  perpor t lonal 1 ty?  But  do  people  even  know  these 
things?  I would  doubt  it,  but  how  do  we  do  without  them? 

Surely  all  of  these  questions  have  answers,  and  the  answers  may  even  be 

expressable  within  the  frame  representation  given  here.  But  there  Is  a lot  of 
work  to  be  done. 

7 . 3 Problems  with  the  Frame  Representation 

There  are  some  major  gaps  In  the  frame  representation  as  it  currently 

stands.  TVo  of  these  have  to  do  with  "having"  and  "location".  Consider: 

Jack  had  to  do  some  painting.  He  did  not  have  paint. 

Q:  Could  Jack  do  the  painting? 

This  example  cannot  be  represented  for  several  reasons.  For  example  Ms. 
Malaprop  does  not  have  any  way  to  represent  "had  to"  or  "could".  These  however 

are  tough  problems  for  everybody.  Tliat  I currently  have  no  way  to  represent 

"not  having"  .something  Is  more  unusual.  To  understand  the  problem  we  must 
realize  that  Ms.  Malaprop  handles  "have"  in  an  unusual,  but  I think  reasonable 
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way. 

It  has  long  been  noted  that  the  "have"  relation  "I  have  a pencil"  Is  very 
different  than  In  "I  have  a TV  set".  Typically  this  Is  understood  as  an 
ambiguity  In  "have".  The  problem  (but  I do  not  care  to  argue  this  point  fully) 
Is  that  under  this  view  the  number  of  possible  "meanings"  of  "have"  Is 
extraordinarily  large.  The  typical  "solution"  of  "hold"  vs.  "own"  Is  not 
sufficient,  and  to  say  that  "have"  can  also  mean  "control"  Is  to  substitute  one 
ambiguous  word  for  another.  Ms.  Malaprop's  approach  Is  to  treat  "PERSON  HAS 
THING"  as  usually  Indicating  that  THING  serves  as  a binding  for  a variable  In 
some  complex  event  frame  in  which  PERSON  participates.  (To  flesh  this  out  we 
will  have  to  retain  OWN,  as  well  as  allow  HAVE  to  serve  as  an  ambiguous  but 
primitive  predicate  In  the  system  so  that  It  will  be  possible  to  learn  only 
later  the  Intended  use.)  In  this  way  we  can  understand  the  particulars  of  the 
HAVE  relation  on  the  basis  of  what  Is  required  In  the  complex  event  frame,  be  It 
"hold"  or  "be  In  the  proximity  of"  or  whatever.  Furthermore  we  can  now  do 
without  the  HAVE  prerequisites  which  people  are  always  putting  In  front  of  every 
action.  These  have  always  bothered  me,  since  I never  was  sure  what  HAVE  was 
suppose  to  mean  In  these  cases  (and  usually  It  varied  from  case  to  case).  Now 
all  of  these  HAVES  are  replaced  by  a rather  obvious  convention  on  frames.  To  do 
an  action  In  a frame,  all  of  the  variables  mentioned  In  the  action  must  be 
bound . 


The  trouble  here  Is  how  do  we  represent  "not  have".  Well,  the  obvious 
thing  will  be  "some  variable  In  some  complex  event  frame  cannot  be  bound".  Note 
that  simply  saying  that  a variable  Is  not  bound  is  not  sufficient,  since  Ms. 
Malaprop's  notm.il  convention  when  finding  an  unbound  variable  Is  to  assume  that 
111.  si. try  teller  has  simply  forgotten  to  mention  the  binding  object.  This  Is  a 
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good  nsBumpt  Ion , but  It  mranH  ili.it  wi'  nood  hoitu-  w/iy  to  s.iy  "this  v/irlablo  Is 
unblndnblo,  at  least  at  th**  current  time".  So  we  can  Invent  a predicate 
UNBINDABLE,  but  Implementing  the  machinery  to  make  use  of  It  will  be  a non 
trivial  task. 

A similar  problem  to  that  of  "have"  Is  Illustrated  In  the  following 
example . 

Jack  was  painting.  He  dipped  the  brush  In  the  paint. 

Q:  Where  Is  the  brush. 

As  with  "not  have",  Ms.  Malaprop  currently  has  no  way  to  represent  "where" 
questions,  and  again  the  cause  Is  an  peculiarity  of  the  representation,  though 
possibly  a good  one.  Ms.  Malaprop  does  not  currently  have  the  concept  of  a 
"location".  One  can  assert  various  locative  statements,  such  as  LIQUID-IN,  or 
CONTACT  but  there  Is  no  concept  of  AT,  In  the  sense  of  (AT  OBJECT  LOCATION) 
where  LOCATION  Is  an  entltly  describing  the  patch  of  space  being  taken  up  by 
OBJECT.  This  makes  Is  difficult  to  compare  various  spacial  predicates  (as  we 
would  want  to  do  In  noting  a change  of  position)  and  also  makes  It  difficult  to 
represent  "where"  questions.  One  way  around  this  problem  Is  to  Introduce  AT, 
but  utilize  It  as  a pointer  to  the  most  specific  Information  we  have  about 
location.  Note  the  similarity  here  to  the  problem  of  ISA  described  In  section 
5.4  • There  I suggested  the  need  for  a pointer  to  the  most  specific  object 

Information  about  a given  object.  Again,  however,  the  status  of  these  pointers 
Is  unclear  at  the  current  time. 

So  far  we  have  looked  al  situations  where  the  frame  representation  has  made 
ll  .lifflciilt  to  express  a particular  concept.  Now  let  us  consider  some  more 
general  problems.  One  difficulty  which  the  reader  has  no  doubt  noted  on  his 
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ovm , Is  thnt  the  use  of  COMES-FROM  and  EEADS-TO  pointers  to  Individual  frame 
statements  makes  It  quite  difficult  to  write  (or  read)  frames  since  they  are 
constantly  referring  to  the  details  of  many  other  frames*  Indeed,  to  some 
degree  this  defeats  the  modularity  1 seek.  I think  that  with  some  clevar 
programming,  this  could  be  eliminated  In  PAINTING,  by  referring  Instead  to  the 
frame  In  wlilch  the  statement  appears  and  then  making  use  of  the  matching 
constraint  to  Insure  that  the  correct  target  statement  Is  located* 

This  may  Indeed  prove  to  be  the  solution,  but  It  Is  not  obvious  that  It 
will  work*  Consider  one  of  the  schemes  I wa-s  thinking  about  for  use  In  the 
restraurant  frames*  The  Idea  Is  that  RESTAURANT  will  not  be  represented  by  a 
single  frame.  Instead  there  will  be  one  frame  (a  COMPLEX -EVENT,  naturally) 
which  will  Include  the  knowledge  of  how  one  acts  the  part  of  the  custormer* 
There  will  be  a second  for  the  waiter,  and  perphaps  others*  The  frames  (I  only 
Indicate  two  here)  are  then  Interconnected  with  LF.\DS-TO  and  COMES-FROM 
pointers. 


RESTAUR ANT  INC  (COM PL EX -EVENT) 

VARS:  ... 

EVENT:  (IN  AGENT  RESTAURANT) 
(SEATED  AGENT) 

(AT  MENU  AGENT) 

COMES-FROM: 

(AT  SERVER  AGENT) 
COMFS-FROM: 

(TELL  AGENT  SERVER  CHOICE) 

(AT  FOOD  TABLE) 

COMES-FROM: 

(EAT  AGENT  FOOD) 

(AT  BILL  AGENT) 

COMES-FROM : 

(ON  TIP  TABLE) 


WAITER  I NG  (COMPLEX-EVENT) 

VARS:  ... 

EVENT:  (ON  DISHES  TABLE) 

(AT  MENU  CLIENT) 

(AT  WAITER  CLIENT) 

(TELL  CLIENT  WAITER  CHOICE) 
COMES-FROM: 

(TELL  WAITER  COOK  CHOICE) 
(GET-FROM  WAITER  FOOD  COOK) 

(AT  FOOD  TkBLE) 

(EAT  CLIENT  FOOD) 
COMES-FROM: 

(AT  BILL  CLIENT) 

(ON  TIP  TABLE) 

COMES-FROM: 

(PICK-UP  WAITER  TIP) 

(NOT  (ON  DISHES  TABLE)) 


This  Is  very  schematized,  and  the  particulars  are  not  to  be  taken  seriously,  but 
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the  general  Idea  of  separating  the  two  processes  seems  quite  plausible  to  me. 
However,  given  the  complexity  of  the  Interaction,  I have  doubts  that  the 
LEADS-TO  and  COMES-FROM  links  can  simply  refer  to,  say,  the  WAITERING  frame.  It 
would  seem  that  they  would  have  to  single  out  the  particular  line.  On  the  other 
hand,  perhaps  such  complex  Interaction  between  frames  Is  a bad  Idea.  At  any 
rate  It  Is  something  to  think  about. 

Anotiier  problem  with  the  representation  is  the  use  of  Intermediaries.  They 
were  Introduced  In  order  to  allow  a COMES-FROM  or  LEADS-TO  pointer  to  something 
which  was  not  a direct  match,  but  which  could  be  made  to  match  by  applying  some 
rule.  An  unfortunate  side  effect  has  been  to  introduce  a new,  and  unwanted 
degree  of  freedom  In  the  construction  of  frames.  For  example,  do  we  want  the 
command  to  clean  the  Instrument  to  lead  to  PAINT-DRY,  or  Instead  to  lead  to  NOT 
ABSORBANT,  using  PAINT -DRY  as  an  Intermediary.  The  formalism  says  nothing  about 
this.  Instead  the  decision  has  been  made  on  the  ad  hoc  level  of  the  results  we 
will  get  when  we  ask  "why  should  one  wash  the  brush".  Given  my  earlier  comments 
about  the  need  for  a more  sophisticated  question  answering  section  anyway,  this 
is  hardly  good  grounds  for  the  decision. 

One  possible  solution  would  be  to  eliminate  Intermediaries.  However  my 
current  experience  suggests  that  this  Is  not  practical.  More  reasonable  would 
be  to  place  a restriction  of  one  Intermediary  per  COMES-FROM  or  LEADS-TO 
pointer.  One  beneficial  effect  would  be  to  eliminate  cases  where  the  use  of 
intermediaries  has  gotten  out  of  hand  through  the  use  of  long  chains  of  them. 
(0»it  of  embarasment  I have  avoided  showing  any  of  these  situations.)  On  the 
other  hand,  this  restriction  would  not  solve  the  problem  mentioned  in  the  last 
paragraph,  lliai  mist  wait  for  more  and  better  restrictions  on  the  formalism. 
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8 CONCLUSION 
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The  last  section  discussed  some  of  the  problems  with  the  program.  Let  me 
conclude  on  a more  upbeat  note. 

Basically  I see  Ms.  Mnlaprop  In  two  ways.  When  viewed  as  a program, 
separate  from  the  frame  representation  It  uses,  Ms-  Malaprop  Is  a working 
example  of  several  ideas  which  are  current  In  the  AI  literature:  the  frame 
recognition  hypothesis,  default  values  In  the  matching  process,  controlled  read 
time  Inference,  dependency  relations  to  undo  false  conclusions,  etc.  But  as  I 
see  It,  the  primary  importance  of  the  program  Is  the  frame  representation  it 
uses.  The  frame  representation  used  here,  while  having  Its  problems.  Is  fairly 
successful  In  terms  of  the  goals  set  out  at  the  beginning  of  this  paper. 

Modul ar 1 ty . Probably  the  major  force  In  the  design  of  the  frame 
representation  is  the  goal  of  modularity.  Tlie  restriction  that  complex  events 
cannot  contain  causa]  relations  was  Instituted  solely  to  push  the  user  Into  the 
difficult  process  of  deciding  what  the  basic  cause  and  effect  relations  are,  and 
expressing  them  In  the  most  general  form  possible.  Adjunct  frames  also 
facilitate  modularity  by  allowing  special  ways  of  doing  things  to  be  separated 
from  the  general  case,  while  still  allowing  the  special  cases  to  make  use  of  the 
general  information.  Tliis  of  course,  is  just  inheritance  of  properties.  What 
makes  adjunct  frames  unusual  Is  the  degree  to  which  they  can  modify  the 
particulars  of  the  master  frame. 

Wi-u^ldljr  knowledge.  Tlie  frame  representation  keeps  a fairly 
clear  separation  l)etween  tlie  farts  it  knows  and  Information  about  how  these 
fact'',  ,ire  to  be  used  In  particular  cases.  Most  of  each  frame  consists  of  the 
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basic  facts.  The  knew)  edge  ef  use  dee;;  eel  strike  t tie  eye  so  readily,  hut  it  is 
also  llier<“.  Tile  most  ohv  lous  placi'  is  i lie  I l''-Nl''.Kl)l''l)  sect  Ions  of  I lie  Iraines. 
The  COMTS-FKOM  and  LEAI)S-TO  pointers  also  specify  control  In  the  sense  that  they 
not  only  point  out  what  other  rule  or  event  comes  Into  play,  but  also  specify 
whether  this  event  Is  a reason  (LEADS-TO),  or  If  Instead  It  Is  there  to  achieve 
a goal  (COMES-FROM) . In  the  latter  case  the  pointer  also  Indicates  wlilch  result 
of  the  action  Is  the  one  we  are  Interestt'd  in. 

Cl eanl Iness . Throughout  the  description  of  the  representation  I have 
endevored  to  keep  thi'  representation  clean  by  specifying  exactly  what  may  and 
may  not  go  Into  the  representation.  COMES-FROM  and  EEADS-TO  pointers  must  link 
matching  statements,  and  If  they  don't  then  lnt(*rmed  1 ar  ies  must  be  given  wliich 
specify  how  a match  Is  to  be  brought  about  . Complex  event  frames  may  not 
directly  specify  cause  and  effect  relations,  while  simple  events  may  only 
specify  one.  A complex  event  may  only  indicate  what  we  wish  to  happen,  and  not 
anything  wVilch  might  happen  at  the  same  time,  such  as  mistakes.  The  use  of 
arbitrary  LISP  programs  has  been  severely  reduced.  As  Indicated  in  section  5, 
all  but  one  of  the  occasions  whore  they  currently  appear  will  be  eliminated  by 
further  refinements  of  the  program,  either  Improved  question  answering 
facilities,  or  by  making  Into  reprc'sc'n  t a t I on  primitives  those*  which  seem 
I nex  t r I c.ib  I y MSPisli  (e.g.,  FtJilAi.).  Finally,  the  ri'strlcllon  that  all 
predic-ates  are  frames  has  pushed  tin*  sc'mant  Ic  representation  into  a few  unusual, 
hut  I think  inic'resting  directions;  most  noticeably  the  c'llmlnatlon  of  ISA, 
HAVE,  and  AT.  Admittedly  I noted  some  problems  related  to  their  absence,  but 
tlwsi*  problems  are  ones  which  previous  systc'ms  papered  over  by  the  use  of 
prt'dicatc's  wtioc's  meaning  was  uncliar. 
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Problrin  solving.  Karly  on  we  noted  that  the  representation  of  PAINTING  was 
wholly  in  terms  of  states  to  be  acheived,  rather  than  actions  to  be  performed. 
Tlie  Idea  here  Is  that  since  the  basic  logic  of  PAINTING,  as  well  as  most  other 
goal  directed  activities  Is  In  terms  of  goal  states  and  snbgoal  states.  It  would 
be  easier  to  connect  i^vir  knowi'dge  of  PAINTING  to  probl<'m  solving  programs  if 
PAINTING  were  itself  represented  in  that  form.  Furthermore,  by  keeping  track  of 
why  things  are  done  (via  the  GOMFS-FROM  and  I,KAPS-TO  links)  we  have  the 
information  necessary  to  handle  unusual  cas<'s.  Finally,  because  of  the  enforced 
modularity,  we  not  only  have  available  the  standard  ways  of  doing  things,  but 
the  more  basic  cause  and  effect  relations  which  would  be  needed  should  the 
standanl  ways  break  down.  Of  course,  Ms.  Malaprop  does  not  have  the  mechanisms 
to  use  this  information  in  problem  solving,  such  as  proper  indexing  of  ways  to 
do  things,  or  subgoal  protection.  It  is  an  open  question  whether  such  things 
are  even  needed  for  story  compreht'ns ion . But  what  does  seem  clear  is  that  the 
basic  strata  of  common  sense  information  can  be  representi'd  so  that  it  can  be 
used  in  both  activities. 
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APPENDIX 

(PAINTING  (COMPLEX-EVENT) 

VARS:  (AGENT  (ANIMATE  AGENT)) 

(OBJECT  (SOLID  OBJECT)) 

(PAINT  (LIQUID  PAINT) 

NORMAL:  (PAINT  PAINT)) 

(SOME-PAINT  (AND  (LIQUID  SOME-PAINT) 

(PART-OF  SOME-PAINT  PAINT))) 

(SOME-PAINT-VOL  (VOLUME  SOM E-PA INT-VOL  SOME-PAINT)) 

(INSTRUMENT  (SOLID  INSTRUMENT) 

NORMAI,;  PA  1 NT  I NG-BRUSll  (PAINT-BRUSH  INSTRUMENT) 

PAINTING-ROLLER  (KOLIJIR  INSTRUMENT) 

PAINTING-ABSORB  (ABSORBANT  INSTRUMENT)) 

(DIRT  (DIRT  DIRT)) 

(PAPER  (SOLID  PAPER)  NORMAL:  (NEWSPAPER  PAPER)) 

GOAL:  PAINTING-GOAL  (EXTERIOR  PAINT  OBJECT) 

COMES-FROM:  ((vLn  I n t p rmoH  I ,nr  I cs ) (PAINTINGS)) 

EVENT:  PAINTINGl  (NOT  (STICKY-ON  DIRT  OBJECT)) 

COMES-FROM:  ((WASH-GOAD) 

LEADS-TO:  ( ( FUKI NGI  ) ) 

PAINTING2  (UNDER  PAPER  OBJECT) 

PAINT  INC  3 

(LOOP  PAINTING4  (STICKY -ON  PAINT  INSTRUMENT) 

COMES-FROM:  ( (LIQUII)-IN2  PAINTING4C 

(LIQUID-IN  INSTRUMENT  PAINT))) 
PAINTINGS  (CONTACT  INSTRUMENT  OBJECT) 

PAINTINGG  (THRESmtOLD-UNDER  SOME-PAINT-VOL) 

LEADS-TO:  ((DRIPI)) 

;M;ikp  surp  thorp  is  nor  too  much  paint  on  tho  Instrument. 

) 

PAINTING?  (NOT  (ATMOSPHERE-CONTACT  SOME-PAINT)) 

;UntIl  thp  Instrument  is  cleani'd,  keep  the  paint  on  It  out  of  the  air. 
COMES-FROM : (( ATMOSPHERE-CONTACTS  ATMOS PHFRE-GONTACTA ) 

;If  wp  keep  INSTRUMENT  out,  then  anything  on  It  will 
;bi'  out  of  the  air  also, 

(LIQU1D-IN4  PAINTING7C  (LIQUID-IN  INSTRUMENT  PAINT))) 

;so  keep  INSTRUMENT  In  the  paint. 

PAINTINCfi  (NOT  (STICKY-ON  SOME-PAINT  INSTRUMENT)) 

COMES-FROM:  (AND  ((WIPE-GOAL  PAINTING8C  (WIPE  INSTRUMENT  PAPER))) 
;Clean  INSTRUMENT  by  wipelng  and  washing. 

((WASH-GOAL))) 

LEADS-TO:  ((PAINT-DRYI  PAINT -DRY4) (PAINTING-ABSORB) ) ) 
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